Download as PDF, PPTX
![@kannonboy
$ cat ~/.gitconfig
[filter "lfs"]
clean = git-lfs clean %f
smudge = git-lfs smudge %f
required = true](https://image.slidesharecdn.com/trackinggameassetswithgitlfs-161111090312/85/Tracking-large-game-assets-with-Git-LFS-35-320.jpg){kind=tracking}
![@kannonboy
POST .../repo.git
I need object cafebabe
@kannonboy
/info/lfs/objects/batch
{“objects”:[
{
“oid”: “cafebabe...”,
“size”: 40689401
}, ...
],
“operation”: “download”}](https://image.slidesharecdn.com/trackinggameassetswithgitlfs-161111090312/85/Tracking-large-game-assets-with-Git-LFS-44-320.jpg){kind=tracking}
![@kannonboy
$ git lfs lock <path>
$ git lfs unlock <path>
$ git lfs locks [-i id] [-p path]](https://image.slidesharecdn.com/trackinggameassetswithgitlfs-161111090312/85/Tracking-large-game-assets-with-Git-LFS-85-320.jpg){kind=tracking}
More Related Content
Similar to Tracking large game assets with Git LFS
![Lect 1 Number systems and base conversions. [Autosaved].pptx](https://cdn.slidesharecdn.com/ss_thumbnails/lect1numbersystemsandbaseconversions-260111134109-67c2d865-thumbnail.jpg?width=640&height=640&fit=bounds)
Tracking large game assets with Git LFS
- 1. TIM PETTERSEN •SENIOR DEVELOPER • ATLASSIAN • @KANNONBOY Tracking game assets with Git LFS
- 2. @kannonboy Photo: Le Mondeen Vidéo @kannonboy
- 3. @kannonboy Photo: Le Mondeen Vidéo @kannonboy
- 4.
- 5. @kannonboy Git LFS! Git LOB! @kannonboy Photo:Le Monde en Vidéo
- 6. @kannonboy ! @kannonboy Photo: Le Mondeen Vidéo Git LFS!
- 7. TIM PETTERSEN •SENIOR DEVELOPER • ATLASSIAN • @KANNONBOY Tracking game assets with Git LFS
- 8. @kannonboy GIT LFS THE PROBLEMWITH BIG FILES Agenda CONVERTING YOUR REPO TIPS FOR TEAMS
- 9.
- 10.
- 11.
- 12. master 98ca9.. bab1e.. fad3d.. 434bb..tree bab1e..parent Tim P <kannonboy@…>1455209277 -0800committer Tim P <kannonboy@…> 1455209277 -0800author My life is my commit message. git cat-file -p 98ca9$ @kannonboy
- 13. git cat-file -p434bb ace23..100644 blob .gitignore dbdbd..100644 blob .gitattributes a0bc3..040000 tree Assets 33d33..040000 tree ProjectSettings b1de7..100755 blob build.sh 7011e..100755 blob README.md typefilemode SHA-1 master 98ca9.. bab1e.. fad3d.. $ 434bb.. @kannonboy
- 14.
- 15.
- 16.
- 17.
- 18.
- 19.
- 20.
- 21.
- 22.
- 23.
- 24.
- 25.
- 26.
- 27.
- 28.
- 29. @kannonboy git pull$ LFS store Githost ☞ ☞ ☞ dabad.. 98ca9.. bab1e.. fad3d.. 86753.. 434bb.. 4749d.. bdd12.. 778aa..
- 30. @kannonboy git pull$ LFS store Githost ☞ ☞ ☞ dabad.. 98ca9.. bab1e.. fad3d.. 86753.. 434bb.. 4749d.. bdd12.. 778aa..
- 31. @kannonboy git checkout bab1e$ LFSstore Git host ☞ ☞ ☞ dabad.. 98ca9.. bab1e.. fad3d.. 86753.. 434bb.. 4749d.. bdd12.. 778aa.. HEAD
- 32. @kannonboy git checkout bab1e$ LFSstore Git host ☞ ☞ ☞ dabad.. 98ca9.. bab1e.. fad3d.. 86753.. 434bb.. 4749d.. bdd12.. 778aa.. HEAD
- 33. @kannonboy https://git-lfs.github.com/spec/v1version sha256:325ddfb…oid 29342295size git cat-file -p4749d$ ☞ ☞ ☞ dabad.. 98ca9.. bab1e.. fad3d.. 86753.. 434bb.. 4749d.. bdd12.. 778aa..
- 34. @kannonboy $ brew installgit-lfs $ git lfs install
- 35. @kannonboy $ cat ~/.gitconfig [filter"lfs"] clean = git-lfs clean %f smudge = git-lfs smudge %f required = true
- 36. @kannonboy $ git lfstrack “*.mp4” $ cat .gitattributes *.mp4 filter=lfs diff=lfs merge=lfs -text
- 37. @kannonboy massive_video.mp4 Work tree dev .git/lfs/objects Clean filter (git-lfsclean) ☞ Index massive_video.mp4 $ .git/objects git add
- 38. @kannonboy $ dev .git/lfs/objects Smudge filter (git-lfs smudge) Worktree massive_video.mp4 ☞ Commit tree massive_video.mp4 .git/objects LFS Store git checkout
- 39.
- 40.
- 41. @kannonboy $ git push GitLFS: (12 of 13 files, 1 skipped) 168.75 MB / 180.87 MB, 12.12 skipped Counting objects: 22, done. ...
- 42. @kannonboy $ git pull remote:Counting objects: 3, done. ... Downloading massive_video.mp4 (38.79 MB) ... 1 file changed, 2 insertions(+)
- 43. @kannonboy $ git clonessh://git@bitbucke.. Cloning into ‘big_repo’ ... Downloading massive_video.mp4 (38.79 MB) ... Checking out files: 100% (13/13), done.
- 44. @kannonboy POST .../repo.git I needobject cafebabe @kannonboy /info/lfs/objects/batch {“objects”:[ { “oid”: “cafebabe...”, “size”: 40689401 }, ... ], “operation”: “download”}
- 45. @kannonboy 200 OK {“objects”:[ {“oid”: “cafebabe…”,“size”: 40689401, “actions”: { “download”: { “href”: “https://…/lfs/cafebabe…”, @kannonboy cafebabe is over there } } ...
- 46. @kannonboy 200 OK {“objects”:[ {“oid”: “cafebabe…”,“size”: 40689401, “actions”: { “download”: { “href”: “https://…/lfs/cafebabe…”, @kannonboy cafebabe is over there “header”: { “Authorization”: “JWT eyJ0eXA…”, } } } ...
- 47. @kannonboy $ ssh git@bitbucketgit-lfs-authenticate project/repo.git download where is the LFS API? @kannonboy
- 48. @kannonboy $ ssh git@bitbucketgit-lfs-authenticate project/repo.git download { “href”: “https://…/lfs/objects/batch”, “header”: { “Authorization”: “JWT eyJ0eXA...” } } where is the LFS API? the LFS API is over there @kannonboy
- 49. @kannonboy $ ssh git@bitbucketgit-lfs-authenticate project/repo.git download { “href”: “https://…/lfs/objects/batch”, “header”: { “Authorization”: “JWT eyJ0eXA...” } } where is the LFS API? the LFS API is over there @kannonboy
- 50. @kannonboy LFS aware Gitserver LFS storeDev git clone https://.. repo data POST /info/lfs/objects/batch LFS objects hypermedia GET …/<objectSHA> smudge filter happens once per file checked out
- 51. @kannonboy LFS storeDev git lfsclone https://.. repo data GET …/<objectSHA> batched smudge filter subtle difference! POST /info/lfs/objects/batch LFS objects hypermedia LFS aware Git server
- 52. @kannonboy # git pullwith LFS disabled $ git -c filter.lfs.smudge= -c filter.lfs.required=false pull # fetch LFS objects as batch $ git lfs pull Speeding up pulls
- 53. @kannonboy # define agit alias $ git config --global alias.plfs "!git -c filter.lfs.smudge= -c filter.lfs.required=false pull && git lfs pull" # then simply... $ git plfs Speeding up pulls
- 54.
- 55.
- 56. 98ca9.. bab1e.. fad3d.. 100mb 150mb $ git lfstrack “*.mp4”
- 57.
- 58. @kannonboy git filter-branch $ gitfilter-branch --force --index-filter 'git rm --cached --ignore-unmatch big_video.mp4’ --prune-empty --tag-name-filter cat -- --all DON’T DO THIS!
- 59. @kannonboy $ git filter—branch--prune-empty --tree-filter ' git config -f .gitconfig lfs.url “https://bitbucket.example.com/team/repo.git” git lfs track "*.mp4" git add .gitattributes .gitconfig for file in $(git ls-files | xargs git check-attr filter | grep "filter: lfs" | sed -r "s/(.*): filter: lfs/1/"); do git rm -f --cached ${file} git add ${file} done' --tag-name-filter cat -- --all @kannonboy DON’T DO THIS EITHER!
- 60.
- 61. @kannonboy BFG Repo-Cleaner @kannonboy 10-720x faster thanfilter-branch built to kill history Git LFS support by @rtyley
- 62. @kannonboy $ git filter—branch--prune-empty --tree-filter ' git config -f .gitconfig lfs.url “https://bitbucket.example.com/team/repo.git” git lfs track "*.mp4" git add .gitattributes .gitconfig for file in $(git ls-files | xargs git check-attr filter | grep "filter: lfs" | sed -r "s/(.*): filter: lfs/1/"); do git rm -f --cached ${file} git add ${file} done' --tag-name-filter cat -- --all @kannonboy DON’T DO THIS EITHER!
- 63. @kannonboy $ brew installbfg $ bfg —-convert-to-git-lfs “*.mp4” --no-blob-protection
- 64. @kannonboy What to track? YesMaybe No SFX Music Textures Spritesheets FMV Code Fonts Materials Text Meshes Animations Scenes if they’re big or change frequently big stuff
- 65. @kannonboy $ 317352 angrybots 194424 angrybots/Assets 112884angrybots/Assets/Textures 32220 angrybots/Assets/Sounds 24460 angrybots/Assets/Objects … du -k angrybots | sort -nr What to track?
- 66.
- 67.
- 68. @kannonboy $ a295ef4… 102437 95372 2cc7063…152171 140443 blob SHA size on disk average blob size generate-larger-than 50000 Identifying large objects
- 69. @kannonboy , PNG, 512x 512 , WAVE audio, 16 bit a295ef4… 102437 95372 2cc7063… 152171 140443 $ generate-larger-than 50000 | add-file-info Identifying large objects
- 70. @kannonboy …/ReBirth.png a295ef4… 10243795372, PNG… …/bot_die.wav 2cc7063… 152171 140443, WAVE… $ generate-larger-than 50000 | add-file-info $ report-on-large-objects big-stuff.txt paths > big-stuff.txt Identifying large objects
- 71. @kannonboy …/bot_die.wav 2cc7063… 152171140443, WAVE… …/ReBirth.png a295ef4… 102437 95372, PNG… $ generate-larger-than 50000 | add-file-info $ report-on-large-objects big-stuff.txt > big-stuff.txt Identifying large objects | sort -k3nr order by average blob size
- 72. @kannonboy $ bfg —-convert-to-git-lfs“*.wav” --no-blob-protection Identifying large objects $ bfg —-convert-to-git-lfs “*.png” --no-blob-protection run once per pattern
- 73.
- 74.
- 75.
- 76.
- 77. @kannonboyBeware merge conflicts@kannonboy
- 78.
- 79.
- 80. @kannonboy master feature0 feature1 File locking (singlebranch model) LAME
- 81.
- 82.
- 83.
- 84.
- 85. @kannonboy $ git lfslock <path> $ git lfs unlock <path> $ git lfs locks [-i id] [-p path]
- 86.
- 87.
- 88. @kannonboy $ git lfsfetch master feature0 feature1
- 89. @kannonboy $ git lfsfetch master feature0 feature1 --recent
- 90. @kannonboy $ git lfsfetch master feature0 feature1 --recent T-minus 7 days
- 91. @kannonboy $ git configlfs.fetchrecentalways “true” lfs.fetchrecentrefsdays lfs.fetchrecentremoterefs lfs.fetchrecentcommitsdays (default = 7) (default = 0) $ git lfs fetch --recent (default = true)
- 92.
- 93.
- 94. @kannonboy lfs.pruneoffsetdays lfs.pruneverifyremotealways (default = 3) Setthis! $ git lfs prune
- 95.
- 96. @kannonboyFetch the barenecessitiesFetch the bare necessities @kannonboy © Disney
- 97. @kannonboy # for abuild that just runs the unit tests $ git lfs fetch --exclude Assets/Textures/** # for an audio engineer $ git lfs fetch --include Assets/Sounds/** $ git config lfs.fetchexclude Assets/Textures/** $ git config lfs.fetchinclude Assets/Sounds/**
- 98. @kannonboyIDEs & GUItools @kannonboy
- 99.
- 100.
- 101.
- 102. @kannonboy version 4.3+ Bitbucket Server go.atlassian.com/git-lfs docs github.com/github/git-lfs source availablenow! bitbucket.org Looking for more? For occasional Git, JIRA & Bitbucket trivia
- 103. @kannonboy unlimited private andpublic repositories for teams of up to 5 Git LFS storage tier builds and deployments tier with Bitbucket Pipelines pull requests, branch controls, JIRA integration, etc go.atlassian.com/gaming FREE
- 104. @kannonboy Tweet your gameor app with the hashtag #BuiltwithBitbucket for a chance to be featured on the Bitbucket gaming page