Conflicts resolution#3

Open

samirsalman wants to merge 328 commits intomasterfrom conflicts-resolution

This pull request is big! We're only showing the most recent 250 commits

Commits on Apr 30, 2021

Commits on May 3, 2021

Make swap.h functions available to external projects
Davide Caroselli
committed
Add GPUSlot in swappable.h
Davide Caroselli
committed

Commits on May 4, 2021

Commits on May 17, 2021

Avoid Ampere misaligment issue
emjotde
committed

Commits on May 24, 2021

Commits on May 25, 2021

Online quantization (marian-nmt#847 )
ykim362
authored

Commits on May 26, 2021

Merged PR 18763: Fix adding new validation metrics with --valid-reset-stalled

Roman Grundkiewicz
authored and
emjotde
committed

Commits on Jun 4, 2021

Commits on Jun 14, 2021

Commits on Jun 18, 2021

changes for review
hieuhoang-ms
committed

Commits on Jun 28, 2021

Merged PR 19597: Enable mpi wrapper to use size larger than MAX_INT
emjotde
committed

Commits on Jul 1, 2021

lock index before creation
hieuhoang-ms
committed

Commits on Jul 2, 2021

Commits on Jul 9, 2021

Commits on Jul 10, 2021

silence unreferenced formal parameter warning on windows
emjotde
committed

Commits on Jul 11, 2021

Binary shortlist (marian-nmt#856 )

Qianqian Zhu
and
kpu
authored

Commits on Jul 16, 2021

Merged PR 19842: Adapt LSH to work with Leaf
emjotde
committed

Commits on Jul 17, 2021

Merged PR 19860: Case augmented data, if not using factored vocab must not set guided alignments

rjai
authored and
emjotde
committed

Commits on Jul 21, 2021

Merged PR 19864: add bias if it exists

hieuhoang-ms
authored and
emjotde
committed

Commits on Jul 22, 2021

Merged PR 19914: Fix Windows Azure Pipelines
Roman Grundkiewicz
committed
Merged PR 19904: Update instructions for building on Windows
Roman Grundkiewicz
committed
Merged PR 19910: Fix training/scoring error with FSM
emjotde
committed

Commits on Jul 30, 2021

Merged PR 19761: Expose SPM Interface from Marian

rjai
authored and
emjotde
committed

Commits on Aug 4, 2021

allow float32 conversion in QS interface
emjotde
committed

Commits on Aug 6, 2021

Merged PR 20070: Run regression tests in Azure Pipelines
Roman Grundkiewicz
committed

Commits on Sep 2, 2021

Merged PR 20560: Update SPM in Marian

rjai
authored and
emjotde
committed

Commits on Sep 7, 2021

Add --allow-unauthenticated when installing CUDA (marian-nmt#878 )
snukky
authored

Commits on Sep 8, 2021

Factor concatenation improvements and documentation (marian-nmt#748 )

authored

Commits on Sep 16, 2021

Merged PR 20230: Add option for running regression tests only in Azure Pipelines

Roman Grundkiewicz
authored and
emjotde
committed

Commits on Sep 20, 2021

Merged PR 20593: Fix and update Azure pipelines
Roman Grundkiewicz
committed

Commits on Sep 28, 2021

Commits on Oct 11, 2021

Remove Ubuntu 16.04 from GitHub workflows (marian-nmt#879 )
snukky
authored

Commits on Oct 13, 2021

Merged PR 20933: beam & batch works for n on-factored models

hieuhoang-ms
authored and
emjotde
committed

Commits on Oct 26, 2021

Merged PR 21166: Keep building on macOS-10.15
Roman Grundkiewicz
committed
Merged PR 21151: Cleaning up fp16 behavior
emjotde
committed

Commits on Nov 21, 2021

Update badges in README.md
snukky
authored

Commits on Nov 23, 2021

Add GCC 11 support (marian-nmt#888 )

XapaJIaMnu
and
snukky
authored

Commits on Nov 25, 2021

Commits on Dec 6, 2021

Commits on Dec 7, 2021

Documentation about how to write code documentation (marian-nmt#891 )

Qianqian Zhu
and
snukky
authored
Fix AVX2+ detection on Mac (marian-nmt#895 )

XapaJIaMnu
and
snukky
authored

Commits on Dec 16, 2021

Commits on Jan 18, 2022

Commits on Jan 24, 2022

Commits on Jan 26, 2022

Layer documentation (marian-nmt#892 )

authored

Commits on Jan 28, 2022

Cherry picked cleaning/refeactoring patches (marian-nmt#905 )

snukky
and
mateuszchudyk
authored

Commits on Jan 30, 2022

Update list of contributors (marian-nmt#906 )
snukky
authored

Commits on Feb 6, 2022

Commits on Feb 7, 2022

Commits on Feb 8, 2022

Commits on Feb 9, 2022

Commits on Feb 10, 2022

Commits on Feb 11, 2022

Commits on Feb 15, 2022

Commits on Feb 16, 2022

better error message
emjotde
committed

Commits on Mar 7, 2022

Merged PR 22939: Fix case augmentation with multi-threaded reading
emjotde
committed

Commits on Mar 16, 2022

Merged PR 23094: Adapt --cost-scaling to more stable setting
emjotde
committed

Commits on Apr 8, 2022

Merged PR 23407: Fix incorrect/missing gradient accumulation for affine biases
emjotde
committed
Merged PR 23415: Set Windows image back to windows-2019

Roman Grundkiewicz
authored and
emjotde
committed

Commits on Apr 11, 2022

Merged PR 23429: Small fixes around fp16 training and batch fitting
emjotde
committed

Commits on Apr 27, 2022

Merge branch 'dynamic_swap_mvp' into features/postpones_valid_and_save
Davide Caroselli
authored
Merge pull request #3 from davidecaroselli/features/postpones_valid_and_save
Davide Caroselli
authored
changed defaults
nicolabertoldi
committed
fix for handling values equals to 0
nicolabertoldi
committed

Commits on May 9, 2022

add fallback option for sampling, for back-compat
emjotde
committed

Commits on May 11, 2022

Update training_state.h
nicolabertoldi
authored

Commits on May 12, 2022

Merged PR 23840: Update CUDA installation script for Ubuntu
Roman Grundkiewicz
committed

Commits on May 13, 2022

Merged PR 22799: Running regression tests on Azure Pipelines
Roman Grundkiewicz
committed

Commits on May 17, 2022

Merge pull request davidecaroselli#4 from davidecaroselli/features/postpones_valid_and_save
Davide Caroselli
authored

Commits on May 18, 2022

Update NVIDIA CUDA signing key for CI; fix for building docs (marian-nmt#932 )
graemenail
authored

Commits on May 26, 2022

merge with internal master
emjotde
committed

Commits on May 30, 2022

Merged PR 24072: Revert changes to transformer caching
emjotde
committed

Commits on May 31, 2022

Update status badges (marian-nmt#935 )
snukky
authored
Merged PR 24111: Remove external reference to Docker images
Roman Grundkiewicz
committed

Commits on Jun 6, 2022

Directory listing in Ubuntu and macOS workflows (marian-nmt#938 )
graemenail
authored

Commits on Aug 10, 2022

Merged PR 25154: Add model shapes flag to model_info.py script
alexandremuzio
committed

Commits on Sep 2, 2022

Commits on Sep 15, 2022

Merged PR 25518: Upgrade Azure Pipelines to macos-12
Roman Grundkiewicz
committed
Merged PR 25465: Choose top checkpoints from train.log for averaging
Roman Grundkiewicz
committed

Commits on Sep 16, 2022

Merged PR 25698: Install Python 3.8 on GPU pool
Roman Grundkiewicz
committed
Merged PR 23767: More principled sampling and force-decoding
emjotde
committed

Commits on Sep 21, 2022

Merged PR 25686: Loading checkpoints from main node only via MPI
emjotde
committed

Commits on Sep 22, 2022

only use tcmalloc_minimal
emjotde
committed

Commits on Sep 26, 2022

Merged PR 25733: Fused inplace ReLU and Dropout in transformer FFN layer
emjotde
committed

Commits on Sep 27, 2022

Merged PR 25836: Check via hashing if re-syncing in local mode is required
emjotde
committed

Commits on Sep 29, 2022

Merged PR 25889: Fixes bad memory access problem in hashing
emjotde
committed

Commits on Oct 4, 2022

Commits on Oct 6, 2022

Merged PR 25950: Add missing defaults for concatenated factors
emjotde
committed

Commits on Oct 10, 2022

Add BeamSearch::setBeamSize() method to dynamically update beam-size
Davide Caroselli
committed

Commits on Nov 1, 2022

Merged PR 26271: Update CI pipeline triggers
Roman Grundkiewicz
committed
Merged PR 26318: Fix incorrect envvar name in Azure Pipeline
Roman Grundkiewicz
committed

Commits on Nov 2, 2022

Commits on Nov 19, 2022

Commits on Nov 20, 2022

Merged PR 26617: Update regression-tests & fix CI pipelines
Roman Grundkiewicz
committed

Commits on Nov 23, 2022

Merged PR 26667: Update examples submodule to fix vulnerability issues

Roman Grundkiewicz
authored and
emjotde
committed

Commits on Nov 29, 2022

Commits on Nov 30, 2022

Merged PR 25220: Add extra model information to model_info.py script

alexandremuzio
authored and
Roman Grundkiewicz
committed

Commits on Dec 20, 2022

Merged PR 27051: Add an option for completely resetting validation metrics
Roman Grundkiewicz
committed

Commits on Feb 10, 2023

Merged PR 26311: [FSM] make model loading lock non-static

Varun Mathur
authored and
emjotde
committed

Commits on Feb 11, 2023

Merged PR 26476: Sanitize guided-alignment with case-augmentation (still somewhat wonky)
emjotde
committed

Commits on Feb 13, 2023

Merged PR 27804: Fallback to old LSH code for MSVC due to bad loop unrolling
emjotde
committed

Commits on Feb 20, 2023

Commits on Feb 21, 2023

version 1.12.0 (marian-nmt#980 )
emjotde
authored

Commits on Feb 22, 2023

Merge internal master with public master
emjotde
committed

Commits on Feb 23, 2023

Merged PR 28059: Add missing default for factors
emjotde
committed

Commits on Feb 27, 2023

Merged PR 27976: Introduce new layer framework into master
emjotde
committed

Commits on Mar 1, 2023

Merged PR 28128: Comet scoring and training with new layer framework
emjotde
committed

Commits on Mar 16, 2023

Merged PR 28460: Revert "Merged PR 26311: [FSM] make model loading lock non-static"

fsigalov
authored and
emjotde
committed

Commits on Mar 17, 2023

Merged PR 28179: comet2marian.py: download comet models automatically.

thammegowda
authored and
emjotde
committed

Commits on Mar 30, 2023

Merged PR 28674: Add --early-stopping-epsilon param
Roman Grundkiewicz
committed

Commits on Apr 13, 2023

Merged PR 28502: Comet2Marian: add --spm argument to download vocabulary file

thammegowda
authored and
emjotde
committed

Commits on Apr 15, 2023

quote CPUINFO in cmake (marian-nmt#983 )
josharian
authored

Commits on Jun 19, 2023

Commits on Jun 27, 2023

Merged PR 30009: Divergence detection and fallback to fp32 if training with fp16 fails
emjotde
committed

Commits on Jun 28, 2023

Merged PR 30038: Add a comment that automatic builds are disabled
Roman Grundkiewicz
committed
Merged PR 30034: Automatically create marian-YYYY-MM-DD-GIT_REV.tgz
emjotde
committed

Commits on Jun 29, 2023

Commits on Jul 1, 2023

Merged PR 30079: Fixes and extends unit test for layer norm
emjotde
committed

Commits on Jul 3, 2023

Merged PR 28078: Various small improvements
emjotde
committed

Commits on Jul 16, 2023

Merged PR 30282: Fix parameter name for norms in new layer framework.
emjotde
committed

Commits on Jul 17, 2023

Merged PR 30198: [quicksand] cache YAML configs

Varun Mathur
authored and
Roman Grundkiewicz
committed

Commits on Jul 22, 2023

Merged PR 30283: Save full checkpoints at saving intervals (with iteration number) when requested.
emjotde
committed

Commits on Jul 24, 2023

Bump src/3rd_party/sentencepiece from 8dc9172 to fb6f8e4 (marian-nmt#1000 )
dependabot[bot]
authored
Merged PR 30415: Fix macOS clang builds
Roman Grundkiewicz
committed

Commits on Jul 25, 2023

Merged PR 30419: Fix Python modules in GPU regression tests

Roman Grundkiewicz
authored and
emjotde
committed
Fix macOS actions (marian-nmt#1002 )
snukky
authored

Commits on Jul 26, 2023

Merged PR 30406: More general fallbacks for diverged training
emjotde
committed

Commits on Jul 27, 2023

Merged PR 30482: Fixes for backward compatibility in fine-tuning
Roman Grundkiewicz
committed

Commits on Jul 31, 2023

Merged PR 30516: Make sure that loss is finite when checking for divergence
emjotde
committed

Commits on Aug 14, 2023

Commits on Aug 15, 2023

don't include nppdefs.h. Problematic on some machines (marian-nmt#1004 )

hieuhoang
and
hieuhoang-ms
authored

Commits on Aug 17, 2023

Add an option to not encode sentencepiece during training/decoding al… (marian-nmt#1003 )
XapaJIaMnu
authored

Commits on Aug 24, 2023