Re: latest master branch flutter build - smudge filter lfs failed downloading

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Sat, Aug 20, 2022 at 02:15:17PM +1000, Bernard wrote:
> Guys I took another look at this following my findings
> 
> @Marius Vlad <marius.vlad@xxxxxxxxxxxxx> Thanks for the dig tip,
> nice utility
> I think DNS is a red herring as intermittent resolution errors do not
> consistently fail on demand against the exact same file
> *plugins/assets/Audio.mp3"
> However took onboard your advice reviewed
> https://developers.google.com/speed/public-dns/ had a play around and
> changed name server to 8.8.8.8 Following output of dig tst.pumpedsvr.com
> github.com. I then cleared everything restarted job and failed again same
> error
> 
> So I was stumped how you're able to build
> "agl-image-flutter-runtimerelease" Scott then confirmed he hasn't yet
> tried, so now i'm now wondering how exactly did you built it. This is what
> i used plain-vanilla are you doing something different?
No, not really. I've just tried now a fresh build with master for both
agl-image-flutter-runtimerelease and agl-ivi-demo-platform-flutter and
they worked just fine on my end. I'm doing the builds in Debian
stable container. Debian testing used to work, but just did an update
and found some other stuff, unrelated to this issue.
>   $ source meta-agl/scripts/aglsetup.sh -f -m qemux86-64 -b qemux86-64
> agl-devel agl-basesystem agl-flutter
>   $ nohup time bitbake agl-image-flutter-runtimerelease &
I'm using agl-demo agl-devel agl-netboot agl-flutter as features.
> 
> Reason being meta-flutter introduced git lfs in the last release. (I don't
> know much about it as we don't commit large files)
> So you would have had to manually install it as the job initially fails
> with git lfs not found.
> My AGL build server is Ubuntu VM on a Fedora host (tst.pumpedsvr.com) so I
> installed https://installati.one/ubuntu/20.04/git-lfs/
> I then fluffed around trying to configure as much as i could after watching
> https://www.youtube.com/watch?v=xPFLAAhuGy0
> But I know something is missing, no idea what, fingers crossed the new
> build recipe contains git-lfs black magic to fill in the blanks!
If this isn't a DNS issue, maybe it's a host-related issue? Although I
suspect that 20.04 is a LTS and supported by yocto.

git lfs seem to apply if git lfs is present in the system, which I
don't see at all on my end.

I've done a git clone for the test repository with and without and seems
to work just fine. I just do not know atm why isn't using git lfs on my end. 
Presumably I don't have that installed.

How about you try the following:

a) purge/remove git lfs entirely (this should be the same on my side
where I don't have git lfs installed). Should then fallback to just
using git.
b) modify the recipe and modify from lfs=1 to lfs=0 and see how that
works. The recipe is at
external/meta-flutter/recipes-graphics/flutter-apps/flutter-test-texture-egl_git.bb
> 
> The call is clearing trying to receive access Audio.mp3 from *within*
>  test.git/info/lfs/objects
> > https://github.com/meta-flutter/tests.git/info/lfs/objects/batch: dial
> tcp:
> > lookup github.com: Temporary failure in name resolution
> 
> build assets folder contains the correct .gitttributes
> [ 2022-08-20 13:44:59 osrservervm01
> /home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/git/plugins/assets
> gitb:(main)  ]
> agl > ls -la .gitattributes
> -rw-r--r-- 1 bcraddock bcraddock 601 Aug 19 21:17 .gitattributes
> 
> identfying Audio.mp3 - But how does my env know to access the lfs?
> [ 2022-08-20 13:45:14 osrservervm01
> /home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/git/plugins/assets
> gitb:(main)  ]
> agl > cat .gitattributes
> bg_header.jpeg filter=lfs diff=lfs merge=lfs -text
> bumble_bee_captions.vtt filter=lfs diff=lfs merge=lfs -text
> bumble_bee_captions.srt filter=lfs diff=lfs merge=lfs -text
> *Audio.mp3 filter=lfs diff=lfs merge=lfs -text*
> Butterfly-209.mp4 filter=lfs diff=lfs merge=lfs -text
> Butterfly-209.webm filter=lfs diff=lfs merge=lfs -text
> flutter-mark-square-64.png filter=lfs diff=lfs merge=lfs -text
> *.mp3 filter=lfs diff=lfs merge=lfs -text
> *.mp4 filter=lfs diff=lfs merge=lfs -text
> *.webm filter=lfs diff=lfs merge=lfs -text
> *.jpeg filter=lfs diff=lfs merge=lfs -text
> *.png filter=lfs diff=lfs merge=lfs -text
> 
> I think this is a Joel issue as his Github CI jobs (I think may have
> git-lfs built in), same as gitlab, and suspect jenkins has a plugin.
> Please advise your what/how really appreciate it show me where i'm wrong
> if you require anything additional from me please ask no problem
> If you concur with my findings, I'll raise github meta-flutter issue
> 
> thanks for your time
> best regards
> Bern
> 
> 
> dig tst.pumpedsvr.com github.com
> ; <<>> DiG 9.10.6 <<>> tst.pumpedsvr.com github.com
> ;; global options: +cmd
> ;; Got answer:
> ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 47742
> ;; flags: qr rd ra; QUERY: 1, ANSWER: 2, AUTHORITY: 0, ADDITIONAL: 1
> 
> ;; OPT PSEUDOSECTION:
> ; EDNS: version: 0, flags:; udp: 512
> ;; QUESTION SECTION:
> ;tst.pumpedsvr.com. IN A
> 
> ;; ANSWER SECTION:
> tst.pumpedsvr.com. 20310 IN CNAME pumpedsvr.com.
> pumpedsvr.com. 20310 IN A 27.32.127.55
> 
> ;; Query time: 33 msec
> ;; SERVER: 8.8.8.8#53(8.8.8.8)
> ;; WHEN: Sat Aug 20 11:19:18 AEST 2022
> ;; MSG SIZE  rcvd: 76
> 
> ;; Got answer:
> ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 50618
> ;; flags: qr rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 0, ADDITIONAL: 1
> 
> ;; OPT PSEUDOSECTION:
> ; EDNS: version: 0, flags:; udp: 512
> ;; QUESTION SECTION:
> ;github.com. IN A
> 
> ;; ANSWER SECTION:
> github.com. 60 IN A 20.248.137.48
> 
> ;; Query time: 9 msec
> ;; SERVER: 8.8.8.8#53(8.8.8.8)
> ;; WHEN: Sat Aug 20 11:19:18 AEST 2022
> ;; MSG SIZE  rcvd: 55
> 
> Bernard Craddock
> Co-founder Pumped Fuel
> www.pumpedfuel.com
> L2, 11 York Street Sydney 2000
> 
> 
> On Wed, Aug 17, 2022 at 6:57 PM Marius Vlad <marius.vlad@xxxxxxxxxxxxx>
> wrote:
> 
> > On Wed, Aug 17, 2022 at 06:06:46PM +1000, Bernard wrote:
> > > Hello Everyone,
> > Hi,
> > > Don't mean to hassle anyone 😋, but I just retried this after 11days as
> > > after catching up with the emails. I see some new meta-flutter changes
> > have
> > > come through.
> > > Just to play it safe I completely zapped my build directory then master
> > > branch repo sync but was surprised I got the exact same error message.
> > > Appreciate any new feedback
> > What does dig @your.nameserver github.com says?
> >
> > Fyi, just done a build of agl-image-flutter-runtimerelease and it works
> > fine, so I suspect you're having intermittent DNS failures. Give 8.8.8.8 or
> > 4.4.4.4 a try and see if it works better.
> > >
> > > $ git-lfs filter-process
> > > Error downloading object: plugins/assets/Audio.mp3 (c0d5157): Smudge
> > error:
> > > Error downloading plugins/assets/Audio.mp3
> > > (c0d515701793564cd80649c10d5f3b85c24ceb5471a29e8a898b9716921f95c5): batch
> > > response: Post
> > > https://github.com/meta-flutter/tests.git/info/lfs/objects/batch: dial
> > tcp:
> > > lookup github.com: Temporary failure in name resolut
> > > ion
> > >
> > > Post https://github.com/meta-flutter/tests.git/info/lfs/objects/batch:
> > dial
> > > tcp: lookup github.com: Temporary failure in name resolution
> > > batch response
> > >
> > > @Joel Winarske <joel.winarske@xxxxxxxxx> I'm going to follow your github
> > > workflow actions for kirkstone-agl-x86_64 see if i can track it down, if
> > i
> > > encounter an issue i'll raise it there
> > >
> > > regards
> > >
> > >
> > > Bernard Craddock
> > > Co-founder Pumped Fuel
> > > www.pumpedfuel.com
> > > L2, 11 York Street Sydney 2000
> > >
> > >
> > > ---------- Forwarded message ---------
> > > From: Bernard Craddock <bernard@xxxxxxxxxxxxxx>
> > > Date: Sat, Aug 6, 2022 at 6:01 PM
> > > Subject: latest master branch flutter build - smudge filter lfs failed
> > > downloading
> > > To: <agl-dev-community@xxxxxxxxxxxxxxxxxxxxxxxxx>, Joel Winarske <
> > > joel.winarske@xxxxxxxxx>, Scott Murray <scott.murray@xxxxxxxxxxxx>
> > >
> > >
> > > Hi @Joel Winarske <joel.winarske@xxxxxxxxx> , @Scott Murray
> > > <scott.murray@xxxxxxxxxxxx>
> > > Any idea why git smudge is preventing me from downloading
> > > plugins/assets/Audio.mp3 and everything else in the assets folder? Is it
> > > anything to do with the .gitattributes file ?
> > > I can download everything else from
> > > https://github.com/meta-flutter/tests/tree/main/plugins just fine.
> > >
> > > please advise
> > > regards
> > >
> > > $ source meta-agl/scripts/aglsetup.sh -f -m qemux86-64 -b qemux86-64
> > > agl-flutter agl-devel
> > > $ nohup time bitbake agl-image-flutter-runtimerelease &
> > >
> > > ERROR: flutter-test-texture-egl-runtimerelease-git-r0 do_unpack: Bitbake
> > > Fetcher Error: FetchError('Fetch command export PSEUDO_DISABLED=1; export
> > > DBUS_SESSION_BUS_ADDRESS="unix:path=/run/user/1001/bus"; export
> > >
> > PATH="/home/bcraddock/AGL/master/qemux86-64/tmp/sysroots-uninative/x86_64-linux/usr/bin:/home/bcraddock/AGL/master/external/poky/scripts:/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/recipe-sysroot-native/usr/bin/x86_64-agl-linux:/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/recipe-sysroot/usr/bin/crossscripts:/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/recipe-sysroot-native/usr/sbin:/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/recipe-sysroot-native/usr/bin:/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/recipe-sysroot-native/sbin:/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/recipe-sysroot-native/bin:/home/bcraddock/AGL/master/external/poky/bitbake/bin:/home/bcraddock/AGL/master/qemux86-64/tmp/hosttools";
> > > export HOME="/home/bcraddock"; git -c core.fsyncobjectfiles=0 -c
> > > gc.autoDetach=false -c core.pager=cat checkout -B main
> > > da096d27ee8e5e74c18eb97f91ac03021363ef5b failed with exit code 128,
> > > output:\nDownloading plugins/assets/Audio.mp3 (122 KB)\nError downloading
> > > object: plugins/assets/Audio.mp3 (c0d5157): Smudge error: Error
> > downloading
> > > plugins/assets/Audio.mp3
> > > (c0d515701793564cd80649c10d5f3b85c24ceb5471a29e8a898b9716921f95c5): batch
> > > response: Post
> > > https://github.com/meta-flutter/tests.git/info/lfs/objects/batch: dial
> > tcp:
> > > lookup github.com: Temporary failure in name resolution\n\nErrors
> > logged to
> > >
> > /home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/git/.git/lfs/logs/20220806T051806.104407578.log\nUse
> > > `git lfs logs last` to view the log.\nerror: external filter \'git-lfs
> > > filter-process\' failed\nfatal: *plugins/assets/Audio.mp3: smudge filter
> > > lfs failed\*n', None)
> > > ERROR: Logfile of failure stored in:
> > >
> > /home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/temp/log.do_unpack.991853
> > > NOTE: recipe flutter-test-texture-egl-runtimerelease-git-r0: task
> > > do_unpack: Failed
> > > ERROR: Task
> > >
> > (virtual:runtimerelease:/home/bcraddock/AGL/master/external/meta-flutter/recipes-graphics/flutter-apps/flutter-test-texture-egl_git.bb:
> > do_unpack)
> > > failed with exit code '1'
> > >
> > > ERROR: Bitbake Fetcher Error: FetchError('Fetch command export
> > > PSEUDO_DISABLED=1; export
> > > DBUS_SESSION_BUS_ADDRESS="unix:path=/run/user/1001/bus"; export
> > >
> > PATH="/home/bcraddock/AGL/master/qemux86-64/tmp/sysroots-uninative/x86_64-linux/usr/bin:/home/bcraddock/AGL/master/external/poky/scripts:/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-6
> > >
> > 4-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/recipe-sysroot-native/usr/bin/x86_64-agl-linux:/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/recipe-sysroot/usr/bin/crossscripts:/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-e
> > >
> > gl-runtimerelease/git-r0/recipe-sysroot-native/usr/sbin:/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/recipe-sysroot-native/usr/bin:/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/recipe-sysroot-native/sbin:/hom
> > >
> > e/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/recipe-sysroot-native/bin:/home/bcraddock/AGL/master/external/poky/bitbake/bin:/home/bcraddock/AGL/master/qemux86-64/tmp/hosttools";
> > > export HOME="/home/bcraddock"; git -c core.fsyncobjectfiles=0 -c
> > > gc.autoDetach=false -c core.pager=cat
> > >  checkout -B main da096d27ee8e5e74c18eb97f91ac03021363ef5b failed with
> > exit
> > > code 128, output:\nDownloading plugins/assets/Audio.mp3 (122 KB)\nError
> > > downloading object: plugins/assets/Audio.mp3 (c0d5157): Smudge error:
> > Error
> > > downloading plugins/assets/Audio.mp3
> > > (c0d515701793564cd80649c10d5f3b85c24ceb5471a29e8a898b9716921f95c5): batch
> > > response:
> > > Post https://github.com/meta-flutter/tests.git/info/lfs/objects/batch:
> > dial
> > > tcp: lookup github.com: Temporary failure in name resolution\n\nErrors
> > > logged to
> > >
> > /home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/git/.git/lfs/logs/
> > > *20220806T051806.104407578.log*\nUse `git lfs logs last` t
> > > o view the log.\nerror: external filter \'git-lfs filter-process\'
> > > failed\nfatal: plugins/assets/Audio.mp3: smudge filter lfs failed\n',
> > None)
> > >
> > > agl > more *20220806T051806.104407578.log*
> > > git-lfs/2.9.2 (GitHub; linux amd64; go 1.13.5)
> > > git version 2.25.1
> > >
> > > $ git-lfs filter-process
> > > Error downloading object: plugins/assets/Audio.mp3 (c0d5157): Smudge
> > error:
> > > Error downloading plugins/assets/Audio.mp3
> > > (c0d515701793564cd80649c10d5f3b85c24ceb5471a29e8a898b9716921f95c5): batch
> > > response: Post
> > > https://github.com/meta-flutter/tests.git/info/lfs/objects/batch: dial
> > tcp:
> > > lookup github.com: Temporary failure in name resolution
> > > Post https://github.com/meta-flutter/tests.git/info/lfs/objects/batch:
> > dial
> > > tcp: lookup github.com: Temporary failure in name resolution
> > >
> > > *ENV*:
> > >
> > LocalWorkingDir=/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/git
> > >
> > LocalGitDir=/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/git/.git
> > >
> > LocalGitStorageDir=/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/git/.git
> > >
> > LocalMediaDir=/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/git/.git/lfs/objects
> > > LocalReferenceDirs=
> > >
> > TempDir=/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/git/.git/lfs/tmp
> > > ConcurrentTransfers=3
> > > TusTransfers=false
> > > BasicTransfersOnly=false
> > > SkipDownloadErrors=false
> > > FetchRecentAlways=false
> > > FetchRecentRefsDays=7
> > > FetchRecentCommitsDays=0
> > > FetchRecentRefsIncludeRemotes=true
> > > PruneOffsetDays=3
> > > PruneVerifyRemoteAlways=false
> > > PruneRemoteName=origin
> > >
> > LfsStorageDir=/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/git/.git/lfs
> > > AccessDownload=none
> > > AccessUpload=none
> > > DownloadTransfers=basic,lfs-standalone-file
> > > UploadTransfers=basic,lfs-standalone-file
> > > GIT_EXEC_PATH=/usr/lib/git-core
> > >
> > GIT_CEILING_DIRECTORIES=/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0
> > > GIT_PREFIX=
> > > GIT_CONFIG_PARAMETERS='core.fsyncobjectfiles=0' 'gc.autoDetach=false'
> > > 'core.pager=cat'
> > >
> > > Bernard Craddock
> > > Co-founder Pumped Fuel
> > > www.pumpedfuel.com
> > > L2, 11 York Street Sydney 2000
> > >
> > >
> > >
> > >
> > >
> >
> >
> > 
> >
> >
> >
> 
> 
> 
> 
> 


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#10085): https://lists.automotivelinux.org/g/agl-dev-community/message/10085
Mute This Topic: https://lists.automotivelinux.org/mt/92851047/2167316
Group Owner: agl-dev-community+owner@xxxxxxxxxxxxxxxxxxxxxxxxx
Unsubscribe: https://lists.automotivelinux.org/g/agl-dev-community/leave/4543822/2167316/883735764/xyzzy [list-automotive-discussions82@xxxxxxxxxxx]
-=-=-=-=-=-=-=-=-=-=-=-


Attachment: signature.asc
Description: PGP signature


[Index of Archives]     [LARTC]     [Bugtraq]     [Yosemite Forum]     [Photo]

  Powered by Linux