GitHub / BlackSamorez/tensor_parallel / commits
Automatically split your PyTorch models on multiple GPUs for training & inference
| SHA | Message | Author | Date | Stats |
|---|---|---|---|---|
| a7d19394 | merge Merge pull request #106 from BlackSamorez/sharding_refactor |
Andrei Panferov <a****i@B****u>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| 7b6f6922 | tests fix | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| ff70748a | merge Merge branch 'main' into sharding_refactor | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 807a2ff0 | merge Merge pull request #113 from BlackSamorez/prepare_model_inputs |
Andrei Panferov <a****i@B****u>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| 57d97c75 | _prepare_model_inputs | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| c40153c7 | merge Merge pull request #110 from BlackSamorez/pretrained_fix |
Andrei Panferov <a****i@B****u>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| f000c03c | version update | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 18fab5d5 | find_predefined_tensor_parallel_config no except | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 31c70978 | merge Merge pull request #108 from tonywang16/patch-1 |
Andrei Panferov <a****i@B****u>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| 6d7384a5 | Update src/tensor_parallel/slicing_configs.py |
Andrei Panferov <a****i@B****u>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| 77d36e2f | merge Merge branch 'main' into patch-1 |
Andrei Panferov <a****i@B****u>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| b935cfb2 | Renaming Zero3 back to Sharded | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 3ed78d20 | fix | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 063a554b | legacy fixed | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| baca7e28 | Reformat code / sort import |
tonywang16 <t****6@g****m>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| e7030ca2 | legacy | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| e0117c13 | merge Merge branch 'main' into sharding_refactor | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| aa3dd94c | merge Merge pull request #109 from BlackSamorez/sharded_tests |
Andrei Panferov <a****i@B****u>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| c06c1ef4 | slight factory tests refactor | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| b915ad8d | isort tests | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 341c7d44 | Bring back tensor_parallel | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 912304d4 | Testing interfaces | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 359608e1 | version update | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 6b6cb69a | back compat | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 58f78390 | Rename Sharded->Zero3 | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| aba4ef14 | Meta+ZeRO-3 | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 87ecdddf | undoing comments | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 06f73148 | correct bloom for testing | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| e8c09202 | get_parameter_name_mapping fix | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 065bb5cb | fixed get_parameter_name_mapping | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 6d901e6b | make_distributed_shard in init | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 0f1f29a1 | factory deprecation and tests | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 3039984b | Encoder fix | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| b1a9411d | Cleaner ZeRO-3 initialization and basic tests | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 9153255d | Always test with config | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| b61db1de | Test ZeRO-3 everywhere | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| a2998100 | Modernized transformers tests | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| c87440eb | Expanding tests | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| a772cb5c | Fix update dict key error |
tonywang16 <t****6@g****m>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| f396b973 | test_saving refactored | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 3f0487ef | Saving kinda works | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 0a5d7e6e | gpt2 fix | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| d1056641 | More explicit ZeRO-3 list | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 23c8256f | Remembering what was split | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 31329ada | merge Merge pull request #103 from BlackSamorez/gpt2-fix |
Andrei Panferov <a****i@B****u>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| 9b83437f | black tests | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 8f1b5839 | undo fix | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| dd6250b6 | version update | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 12ec0866 | gpt2 fix | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 20b1cfb0 | merge Merge pull request #100 from tomoki0924/fix/distribute |
Andrei Panferov <a****i@B****u>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| 3efdf940 | merge Merge branch 'main' into fix/distribute |
Andrei Panferov <a****i@B****u>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| 304c3c46 | merge Merge pull request #102 from BlackSamorez/version |
Andrei Panferov <a****i@B****u>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| 7fbd0a1c | version bump | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 332638b5 | merge Merge pull request #101 from BlackSamorez/deps |
Iaroslav Lisniak <4****k@u****m>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| 18c38cc0 | idk | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| a66f23b9 | skip llama2 with old transformers | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| e0409366 | back compat again | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 4ae93c01 | Back compat llama | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 5d771650 | llama-2 | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 73c5a65a | peft==0.3.0 | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 7ec96619 | dev deps update | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| c201f9b9 | merge Merge branch 'main' into fix/distribute |
Tomoki Hoshino <4****4@u****m>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| a965b3e5 | fix | Tomoki Hoshino <4****4@u****m> | over 3 years ago | |
| e4e98be7 | fix | Tomoki Hoshino <4****4@u****m> | over 3 years ago | |
| 0f8dcc9b | merge Merge pull request #93 from BlackSamorez/readme_fixes |
Andrei Panferov <a****i@B****u>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| 2aa85960 | readme fixes | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 9e8ced16 | merge Merge pull request #92 from BlackSamorez/falcon |
Andrei Panferov <a****i@B****u>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| db8da5a7 | version update | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| d6cc91da | merge Merge branch 'main' into falcon |
Andrei Panferov <a****i@B****u>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| 10533c1c | falcon hotfix | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| f8475bcf | merge Merge pull request #91 from BlackSamorez/falcon |
Iaroslav Lisniak <4****k@u****m>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| bbd5f405 | not testing falcon with torch<2.0 | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 700140ab | torch 2.0 removed | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 5165cb07 | torch 2.0 for tests | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 74401e33 | einops | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 7e990d69 | more falcon config checks | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| af8caab8 | falcon test generate | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| f27b10e0 | falcon test forward | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 81f31dc6 | gather_kv fix | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 61b2f511 | falcon embeddings and LM head split | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 96d4a863 | falcon mlp split | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| f5c2c860 | falcon attention sliced | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 8b7a3b4a | merge Merge pull request #90 from BlackSamorez/dispatch |
Iaroslav Lisniak <4****k@u****m>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| aea6285c | version update | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| d30879e0 | error msg fix | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 840e235c | Dispatching over ZeRO-3 | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 62e54240 | merge Merge pull request #87 from BlackSamorez/peft_unimport |
Andrei Panferov <a****i@B****u>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| 3833fad4 | version update | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| d30c542b | python 3.7 compatible version check | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| e1df3aea | Better peft check | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 24ef8ae7 | Not importing peft | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 3bb330ea | merge Merge pull request #82 from BlackSamorez/gpt2 |
Andrei Panferov <a****i@B****u>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| 19d3d27c | merge Merge branch 'main' into gpt2 |
Andrei Panferov <a****i@B****u>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| 92195be5 | SplitInsideChunks use | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| 71a98eda | merge Merge pull request #78 from BlackSamorez/BlackSamorez-readme-patch |
Andrei Panferov <a****i@B****u>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| 54f88207 | Finalized readme |
Andrei Panferov <a****i@B****u>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| 0f2c00f6 | fixed tp.convert_state_dict example |
Andrei Panferov <a****i@B****u>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| f99e2009 | merge Merge pull request #73 from BlackSamorez/state_dict_fixes |
Iaroslav Lisniak <4****k@u****m>
Committed by: GitHub <n****y@g****m> |
over 3 years ago | |
| 4314ad3a | tiny models suck | Andrei Panferov <a****i@b****u> | over 3 years ago | |
| e9f8b51a | lru_cache | Andrei Panferov <a****i@b****u> | over 3 years ago |