GitHub / ArchiveTeam/github-grab / commits
Archiving GitHub
| SHA | Message | Author | Date | Stats |
|---|---|---|---|---|
| b0b703bc | Version 20231102.01. Do not keep partial files over rsync. Check for minimum ... | arkiver <a****r@p****m> | almost 3 years ago | |
| 3ac2d2a4 | merge Merge pull request #10 from imerr/master-1 |
arkiver <8****2@u****m>
Committed by: GitHub <n****y@g****m> |
about 3 years ago | |
| 7a1283f6 | Extra docker container params |
Robin Rolf <i****r@i****c>
Committed by: GitHub <n****y@g****m> |
about 3 years ago | |
| f7437a39 | Version 20230727.01. Use GNU Wget 1.21.3-at.20230623.01. Use Wget-AT option -... | arkiver <a****r@p****m> | about 3 years ago | |
| 8c14051d | Version 20230607.01. Use GNU Wget 1.21.3-at.20230605.01 and arguments around ... | arkiver <a****r@p****m> | about 3 years ago | |
| e06ba186 | Version 20221201.01. Support GNU Wget 1.21.3-at.20220608.02. | arkiver <a****r@p****m> | almost 4 years ago | |
| dd15afda | Version 20220605.01. Support GNU Wget 1.21.3-at.20220503.02. Fix killing craw... | arkiver <a****r@p****m> | over 4 years ago | |
| 94a6aab7 | Version 20220425.01. Fix backfeed queuing. | arkiver <a****r@p****m> | over 4 years ago | |
| 967c5e59 | Version 20220324.01. Fix variable name. | arkiver <a****r@p****m> | over 4 years ago | |
| f31a1225 | Version 20220323.02. Fix items to maxtries variable name. Fix variable name i... | arkiver <a****r@p****m> | over 4 years ago | |
| d10d24b6 | Version 20220323.01. Fix backfeed for large numbers of discovered URLs. Fix m... | arkiver <a****r@p****m> | over 4 years ago | |
| 74627865 | Version 20220318.01. Restrict query value to single term. Support , in fork n... | arkiver <a****r@p****m> | over 4 years ago | |
| 5ba6f0fb | Version 20220316.01. Various fixes. | arkiver <a****r@p****m> | over 4 years ago | |
| 76ede1b4 | Version 20220315.02. Backfeed v2. Do not queue timestamp items for web:comple... | arkiver <a****r@p****m> | over 4 years ago | |
| 8a8ded73 | Version 20220315.01. Backfeed v2. | arkiver <a****r@p****m> | over 4 years ago | |
| 246eda2f | Version 20211228.02. Support discussions. Queue outlinks to urls-grab. | arkiver <a****r@p****m> | over 4 years ago | |
| d263fd63 | Version 20211228.01. Fix archiving zip and tar.gz archives. | arkiver <a****r@p****m> | over 4 years ago | |
| 9d92d782 | Version 20211220.01. Initial fixes. | arkiver <a****r@p****m> | over 4 years ago | |
| d59d9b05 | Version 20211025.01. Use GNU Wget 1.20.3-at.20211001.01. | arkiver <a****r@p****m> | almost 5 years ago | |
| d5ed8647 | merge Version 20210730.02. Fix conflicts. | arkiver <a****r@p****m> | about 5 years ago | |
| 8c276b93 | Version 20210730.01. Ignore /refs$, handle signup? and various chunk-*.js fil... | arkiver <a****r@p****m> | about 5 years ago | |
| 75464a60 | 20210410.01 - New day new wget-at |
Thomas Glass <m****e@t****s>
Committed by: GitHub <n****y@g****m> |
over 5 years ago | |
| d8657cb6 | Fix docker base image |
Thomas Glass <m****e@t****s>
Committed by: GitHub <n****y@g****m> |
over 5 years ago | |
| c1bc2399 | Fix zstd, now get, latest wget-at and version bump |
Thomas Glass <m****e@t****s>
Committed by: GitHub <n****y@g****m> |
over 5 years ago | |
| 3919fccb | merge Merge pull request #2 from tech234a/patch-1 |
Thomas Glass <m****e@t****s>
Committed by: GitHub <n****y@g****m> |
over 5 years ago | |
| d6d48d51 | Fix Warrior support |
tech234a <4****a@u****m>
Committed by: GitHub <n****y@g****m> |
over 5 years ago | |
| 08b3a9fb | Enable warriors + updated tracker host |
Thomas Glass <m****e@t****s>
Committed by: GitHub <n****y@g****m> |
over 5 years ago | |
| b35b8d9f | Version 20210119.03. Do not get amazonaws.com URLs from the front project page. | arkiver <a****r@p****m> | over 5 years ago | |
| 844c5423 | Version 20210119.02. Fix getting timestamp. Also it is queuing to github-next... | arkiver <a****r@p****m> | over 5 years ago | |
| 52478f0a | merge Merge branch 'master' of https://github.com/ArchiveTeam/github-grab | arkiver <a****r@p****m> | over 5 years ago | |
| ed1ba3a2 | Version 20210119.01. Queue new items to reddit-next project. | arkiver <a****r@p****m> | over 5 years ago | |
| a2a0b33e | Update grab-base |
km09 <2****9@u****m>
Committed by: GitHub <n****y@g****m> |
almost 6 years ago | |
| 9aeb5012 | Version 20201031.02. Support Wget-AT version .20.3-at.20201030.01. | arkiver <a****r@p****m> | almost 6 years ago | |
| 630da801 | Version 20201031.01. Get branches for :complete: items. | arkiver <a****r@p****m> | almost 6 years ago | |
| 80860858 | Version 20201022.01. Fix ignoring renamed js files on GitHub. | arkiver <a****r@p****m> | almost 6 years ago | |
| ac1cbfff | Version 20200930.01. Support web:complete: item. | arkiver <a****r@p****m> | almost 6 years ago | |
| 8b918907 | Version 20200919.02. Archive tar.gz archive if no stars or forks, but custom ... | arkiver <a****r@p****m> | almost 6 years ago | |
| f0b90b9f | Version 20200919.01. Support Wget-AT version 1.20.3-at.20200919.01. | arkiver <a****r@p****m> | almost 6 years ago | |
| 4b6b16ca | Version 20200917.01. Support Wget-AT version 1.20.3-at.20200917.01. | arkiver <a****r@p****m> | almost 6 years ago | |
| 3fa2956c | Version 20200911.01. Add SHA1 hash of item name to warc_file_base. | arkiver <a****r@p****m> | almost 6 years ago | |
| 90dfcc9e | Version 20200909.02. Use socket.url to get absolute URL. Ignore URLs with cer... | arkiver <a****r@p****m> | almost 6 years ago | |
| 09a9a078 | Version 20200909.01. Add timeout of 3 seconds for getting target information.... | arkiver <a****r@p****m> | almost 6 years ago | |
| 660e0ccd | Version 20200904.03. Archive certain /_render_node/ URLs. Archive old edited ... | arkiver <a****r@p****m> | almost 6 years ago | |
| a59f5a7c | Version 20200904.02. Remove debug line. | arkiver <a****r@p****m> | about 6 years ago | |
| 9f6ced6b | Version 20200904.01. Make URL check case insensitive. | arkiver <a****r@p****m> | about 6 years ago | |
| 76c6302e | Version 20200903.01. Add rsync finding capabilities. | arkiver <a****r@p****m> | about 6 years ago | |
| ef5848d8 | Version 20200902.01. Support Wget-AT version 1.20.3-at.20200902.01. Do not wr... | arkiver <a****r@p****m> | about 6 years ago | |
| 3e376b8b | Version 20200901.05. Fix extraction of stars and forks when number is 1. | arkiver <a****r@p****m> | about 6 years ago | |
| f6f39d74 | Version 20200901.04. Fix extraction of of large numbers of forks or stars. | arkiver <a****r@p****m> | about 6 years ago | |
| 87f7a7eb | Version 20200901.03. Do not ignore two tree URLs containing partial HTML data. | arkiver <a****r@p****m> | about 6 years ago | |
| f3c6a3f1 | Version 20200901.02. Use trackerproxy for getting ZSTD dictionary. | arkiver <a****r@p****m> | about 6 years ago | |
| cafaa95b | Version 20200901.01. Get unix time from trackerproxy.archiveteam.org. Remove ... | arkiver <a****r@p****m> | about 6 years ago | |
| 29212bfa | Version 20200831.03. Set tracker ID to github. | arkiver <a****r@p****m> | about 6 years ago | |
| a918e612 | Version 20200831.02. Assert config is 'initial'. | arkiver <a****r@p****m> | about 6 years ago | |
| b6a7493b | Version 20200831.01. Use number of stars and forks to decide on downloading a... | arkiver <a****r@p****m> | about 6 years ago | |
| 2f12723d | Version 20200821.03. Ignore zip archives. | arkiver <a****r@p****m> | about 6 years ago | |
| 8776e3b1 | Version 20200821.02. Set tracker host to trackerproxy.archiveteam.org. | arkiver <a****r@p****m> | about 6 years ago | |
| dc529840 | Version 20200821.01. Ignore bad status codes from camo.githubusercontent.com.... | arkiver <a****r@p****m> | about 6 years ago | |
| 51db9ef3 | Version 20200813.01. Do not use API anymore due to harsh rate limit. | arkiver <a****r@p****m> | about 6 years ago | |
| 493dfa95 | Version 20200812.07. Ignore external homepages. | arkiver <a****r@p****m> | about 6 years ago | |
| df6a5c26 | Version 20200812.06. Improve check for valid homepage. | arkiver <a****r@p****m> | about 6 years ago | |
| e5fa58ab | Version 20200812.05. Check length of homepage before processing. | arkiver <a****r@p****m> | about 6 years ago | |
| c8dbd009 | Version 20200812.04. Use tracker githubtest2. | arkiver <a****r@p****m> | about 6 years ago | |
| 05c2b494 | Version 20200812.03. | arkiver <a****r@p****m> | about 6 years ago | |
| 2dd0fbf9 | Version 20200812.02. Support external pages sites. | arkiver <a****r@p****m> | about 6 years ago | |
| 7cec7b5c | Check validity of URL. | arkiver <a****r@p****m> | about 6 years ago | |
| bd0c7ed1 | Version 20200812.01. Commented out support for external domains. | arkiver <a****r@p****m> | about 6 years ago | |
| 9ebed94a | Version 20200811.02. Handle github.io repositories. Handle amazonaws.com rele... | arkiver <a****r@p****m> | about 6 years ago | |
| b9a34a75 | Version 20200811.01. Archive all tags if repository is no fork, else only dow... | arkiver <a****r@p****m> | about 6 years ago | |
| fd52c3b9 | Version 20200806.03. Skip status code 451. | arkiver <a****r@p****m> | about 6 years ago | |
| e1e19b92 | Version 20200806.02. Support github.io URLs. | arkiver <a****r@p****m> | about 6 years ago | |
| bc04b52a | merge Merge branch 'master' of https://github.com/ArchiveTeam/github-grab | arkiver <a****r@p****m> | about 6 years ago | |
| e46aa65b | Version 20200806.01. Add ignores. | arkiver <a****r@p****m> | about 6 years ago | |
| b5d68306 | use wget-at instead of wget-lua | Katie Holly <g****t@m****s> | about 6 years ago | |
| ccb524b0 | update to latest grab-base | Katie Holly <g****t@m****s> | about 6 years ago | |
| 2d65a47f | Version 20200805.02. Force github for dictionar project ID. | arkiver <a****r@p****m> | about 6 years ago | |
| b6562fe5 | Version 20200805.01. Change tracker to githubtest. | arkiver <a****r@p****m> | about 6 years ago | |
| 244882c8 | Version 20200804.02. Remove sleep. | arkiver <a****r@p****m> | about 6 years ago | |
| 5a8f6af1 | Version 20200804.01. Do not write BANNED file. | arkiver <a****r@p****m> | about 6 years ago | |
| 7b5ba4ba | Initial | arkiver <a****r@p****m> | about 6 years ago |