Re: latest master branch flutter build - smudge filter lfs failed downloading

["Bernard" <bernard@xxxxxxxxxxxxxx>]

Guys I took another look at this following my findings

@Marius Vlad Thanks for the dig tip, nice utility 

I think DNS is a red herring as intermittent resolution errors do not consistently fail on demand against the exact same file *plugins/assets/Audio.mp3"

However took onboard your advice reviewed https://developers.google.com/speed/public-dns/ had a play around and changed name server to 8.8.8.8 Following output of dig tst.pumpedsvr.com github.com. I then cleared everything restarted job and failed again same error 

So I was stumped how you're able to build "agl-image-flutter-runtimerelease" Scott then confirmed he hasn't yet tried, so now i'm now wondering how exactly did you built it. This is what i used plain-vanilla are you doing something different?

  $ source meta-agl/scripts/aglsetup.sh -f -m qemux86-64 -b qemux86-64 agl-devel agl-basesystem agl-flutter

  $ nohup time bitbake agl-image-flutter-runtimerelease &

Reason being meta-flutter introduced git lfs in the last release. (I don't know much about it as we don't commit large files)
So you would have had to manually install it as the job initially fails with git lfs not found.
My AGL build server is Ubuntu VM on a Fedora host (tst.pumpedsvr.com) so I installed https://installati.one/ubuntu/20.04/git-lfs/
I then fluffed around trying to configure as much as i could after watching https://www.youtube.com/watch?v=xPFLAAhuGy0
But I know something is missing, no idea what, fingers crossed the new build recipe contains git-lfs black magic to fill in the blanks!

The call is clearing trying to receive access Audio.mp3 from within test.git/info/lfs/objects

> https://github.com/meta-flutter/tests.git/info/lfs/objects/batch: dial tcp:
> lookup github.com: Temporary failure in name resolution

build assets folder contains the correct .gitttributes

[ 2022-08-20 13:44:59 osrservervm01 /home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/git/plugins/assets gitb:(main)  ]
agl > ls -la .gitattributes
-rw-r--r-- 1 bcraddock bcraddock 601 Aug 19 21:17 .gitattributes

identfying Audio.mp3 - But how does my env know to access the lfs?
[ 2022-08-20 13:45:14 osrservervm01 /home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/git/plugins/assets gitb:(main)  ]
agl > cat .gitattributes
bg_header.jpeg filter=lfs diff=lfs merge=lfs -text
bumble_bee_captions.vtt filter=lfs diff=lfs merge=lfs -text
bumble_bee_captions.srt filter=lfs diff=lfs merge=lfs -text
Audio.mp3 filter=lfs diff=lfs merge=lfs -text
Butterfly-209.mp4 filter=lfs diff=lfs merge=lfs -text
Butterfly-209.webm filter=lfs diff=lfs merge=lfs -text
flutter-mark-square-64.png filter=lfs diff=lfs merge=lfs -text
*.mp3 filter=lfs diff=lfs merge=lfs -text
*.mp4 filter=lfs diff=lfs merge=lfs -text
*.webm filter=lfs diff=lfs merge=lfs -text
*.jpeg filter=lfs diff=lfs merge=lfs -text
*.png filter=lfs diff=lfs merge=lfs -text

I think this is a Joel issue as his Github CI jobs (I think may have git-lfs built in), same as gitlab, and suspect jenkins has a plugin.

Please advise your what/how really appreciate it show me where i'm wrong

if you require anything additional from me please ask no problem

If you concur with my findings, I'll raise github meta-flutter issue

thanks for your time

best regards

Bern

dig tst.pumpedsvr.com github.com
; <<>> DiG 9.10.6 <<>> tst.pumpedsvr.com github.com
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 47742
;; flags: qr rd ra; QUERY: 1, ANSWER: 2, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 512
;; QUESTION SECTION:
;tst.pumpedsvr.com. IN A

;; ANSWER SECTION:
tst.pumpedsvr.com. 20310 IN CNAME pumpedsvr.com.
pumpedsvr.com. 20310 IN A 27.32.127.55

;; Query time: 33 msec
;; SERVER: 8.8.8.8#53(8.8.8.8)
;; WHEN: Sat Aug 20 11:19:18 AEST 2022
;; MSG SIZE  rcvd: 76

;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 50618
;; flags: qr rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 512
;; QUESTION SECTION:
;github.com. IN A

;; ANSWER SECTION:
github.com. 60 IN A 20.248.137.48

;; Query time: 9 msec
;; SERVER: 8.8.8.8#53(8.8.8.8)
;; WHEN: Sat Aug 20 11:19:18 AEST 2022
;; MSG SIZE  rcvd: 55

Bernard Craddock

Co-founder Pumped Fuel

www.pumpedfuel.com

L2, 11 York Street Sydney 2000

On Wed, Aug 17, 2022 at 6:57 PM Marius Vlad <marius.vlad@xxxxxxxxxxxxx> wrote:

On Wed, Aug 17, 2022 at 06:06:46PM +1000, Bernard wrote:
> Hello Everyone,
Hi,
> Don't mean to hassle anyone 😋, but I just retried this after 11days as
> after catching up with the emails. I see some new meta-flutter changes have
> come through.
> Just to play it safe I completely zapped my build directory then master
> branch repo sync but was surprised I got the exact same error message.
> Appreciate any new feedback
What does dig @your.nameserver github.com says?

Fyi, just done a build of agl-image-flutter-runtimerelease and it works
fine, so I suspect you're having intermittent DNS failures. Give 8.8.8.8 or
4.4.4.4 a try and see if it works better.
>
> $ git-lfs filter-process
> Error downloading object: plugins/assets/Audio.mp3 (c0d5157): Smudge error:
> Error downloading plugins/assets/Audio.mp3
> (c0d515701793564cd80649c10d5f3b85c24ceb5471a29e8a898b9716921f95c5): batch
> response: Post
> https://github.com/meta-flutter/tests.git/info/lfs/objects/batch: dial tcp:
> lookup github.com: Temporary failure in name resolut
> ion
>
> Post https://github.com/meta-flutter/tests.git/info/lfs/objects/batch: dial
> tcp: lookup github.com: Temporary failure in name resolution
> batch response
>
> @Joel Winarske <joel.winarske@xxxxxxxxx> I'm going to follow your github
> workflow actions for kirkstone-agl-x86_64 see if i can track it down, if i
> encounter an issue i'll raise it there
>
> regards
>
>
> Bernard Craddock
> Co-founder Pumped Fuel
> www.pumpedfuel.com
> L2, 11 York Street Sydney 2000
>
>
> ---------- Forwarded message ---------
> From: Bernard Craddock <bernard@xxxxxxxxxxxxxx>
> Date: Sat, Aug 6, 2022 at 6:01 PM
> Subject: latest master branch flutter build - smudge filter lfs failed
> downloading
> To: <agl-dev-community@xxxxxxxxxxxxxxxxxxxxxxxxx>, Joel Winarske <
> joel.winarske@xxxxxxxxx>, Scott Murray <scott.murray@xxxxxxxxxxxx>
>
>
> Hi @Joel Winarske <joel.winarske@xxxxxxxxx> , @Scott Murray
> <scott.murray@xxxxxxxxxxxx>
> Any idea why git smudge is preventing me from downloading
> plugins/assets/Audio.mp3 and everything else in the assets folder? Is it
> anything to do with the .gitattributes file ?
> I can download everything else from
> https://github.com/meta-flutter/tests/tree/main/plugins just fine.
>
> please advise
> regards
>
> $ source meta-agl/scripts/aglsetup.sh -f -m qemux86-64 -b qemux86-64
> agl-flutter agl-devel
> $ nohup time bitbake agl-image-flutter-runtimerelease &
>
> ERROR: flutter-test-texture-egl-runtimerelease-git-r0 do_unpack: Bitbake
> Fetcher Error: FetchError('Fetch command export PSEUDO_DISABLED=1; export
> DBUS_SESSION_BUS_ADDRESS="unix:path=/run/user/1001/bus"; export
> PATH="/home/bcraddock/AGL/master/qemux86-64/tmp/sysroots-uninative/x86_64-linux/usr/bin:/home/bcraddock/AGL/master/external/poky/scripts:/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/recipe-sysroot-native/usr/bin/x86_64-agl-linux:/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/recipe-sysroot/usr/bin/crossscripts:/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/recipe-sysroot-native/usr/sbin:/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/recipe-sysroot-native/usr/bin:/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/recipe-sysroot-native/sbin:/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/recipe-sysroot-native/bin:/home/bcraddock/AGL/master/external/poky/bitbake/bin:/home/bcraddock/AGL/master/qemux86-64/tmp/hosttools";
> export HOME="/home/bcraddock"; git -c core.fsyncobjectfiles=0 -c
> gc.autoDetach=false -c core.pager=cat checkout -B main
> da096d27ee8e5e74c18eb97f91ac03021363ef5b failed with exit code 128,
> output:\nDownloading plugins/assets/Audio.mp3 (122 KB)\nError downloading
> object: plugins/assets/Audio.mp3 (c0d5157): Smudge error: Error downloading
> plugins/assets/Audio.mp3
> (c0d515701793564cd80649c10d5f3b85c24ceb5471a29e8a898b9716921f95c5): batch
> response: Post
> https://github.com/meta-flutter/tests.git/info/lfs/objects/batch: dial tcp:
> lookup github.com: Temporary failure in name resolution\n\nErrors logged to
> /home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/git/.git/lfs/logs/20220806T051806.104407578.log\nUse
> `git lfs logs last` to view the log.\nerror: external filter \'git-lfs
> filter-process\' failed\nfatal: *plugins/assets/Audio.mp3: smudge filter
> lfs failed\*n', None)
> ERROR: Logfile of failure stored in:
> /home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/temp/log.do_unpack.991853
> NOTE: recipe flutter-test-texture-egl-runtimerelease-git-r0: task
> do_unpack: Failed
> ERROR: Task
> (virtual:runtimerelease:/home/bcraddock/AGL/master/external/meta-flutter/recipes-graphics/flutter-apps/flutter-test-texture-egl_git.bb:do_unpack)
> failed with exit code '1'
>
> ERROR: Bitbake Fetcher Error: FetchError('Fetch command export
> PSEUDO_DISABLED=1; export
> DBUS_SESSION_BUS_ADDRESS="unix:path=/run/user/1001/bus"; export
> PATH="/home/bcraddock/AGL/master/qemux86-64/tmp/sysroots-uninative/x86_64-linux/usr/bin:/home/bcraddock/AGL/master/external/poky/scripts:/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-6
> 4-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/recipe-sysroot-native/usr/bin/x86_64-agl-linux:/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/recipe-sysroot/usr/bin/crossscripts:/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-e
> gl-runtimerelease/git-r0/recipe-sysroot-native/usr/sbin:/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/recipe-sysroot-native/usr/bin:/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/recipe-sysroot-native/sbin:/hom
> e/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/recipe-sysroot-native/bin:/home/bcraddock/AGL/master/external/poky/bitbake/bin:/home/bcraddock/AGL/master/qemux86-64/tmp/hosttools";
> export HOME="/home/bcraddock"; git -c core.fsyncobjectfiles=0 -c
> gc.autoDetach=false -c core.pager=cat
>  checkout -B main da096d27ee8e5e74c18eb97f91ac03021363ef5b failed with exit
> code 128, output:\nDownloading plugins/assets/Audio.mp3 (122 KB)\nError
> downloading object: plugins/assets/Audio.mp3 (c0d5157): Smudge error: Error
> downloading plugins/assets/Audio.mp3
> (c0d515701793564cd80649c10d5f3b85c24ceb5471a29e8a898b9716921f95c5): batch
> response:
> Post https://github.com/meta-flutter/tests.git/info/lfs/objects/batch: dial
> tcp: lookup github.com: Temporary failure in name resolution\n\nErrors
> logged to
> /home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/git/.git/lfs/logs/
> *20220806T051806.104407578.log*\nUse `git lfs logs last` t
> o view the log.\nerror: external filter \'git-lfs filter-process\'
> failed\nfatal: plugins/assets/Audio.mp3: smudge filter lfs failed\n', None)
>
> agl > more *20220806T051806.104407578.log*
> git-lfs/2.9.2 (GitHub; linux amd64; go 1.13.5)
> git version 2.25.1
>
> $ git-lfs filter-process
> Error downloading object: plugins/assets/Audio.mp3 (c0d5157): Smudge error:
> Error downloading plugins/assets/Audio.mp3
> (c0d515701793564cd80649c10d5f3b85c24ceb5471a29e8a898b9716921f95c5): batch
> response: Post
> https://github.com/meta-flutter/tests.git/info/lfs/objects/batch: dial tcp:
> lookup github.com: Temporary failure in name resolution
> Post https://github.com/meta-flutter/tests.git/info/lfs/objects/batch: dial
> tcp: lookup github.com: Temporary failure in name resolution
>
> *ENV*:
> LocalWorkingDir=/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/git
> LocalGitDir=/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/git/.git
> LocalGitStorageDir=/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/git/.git
> LocalMediaDir=/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/git/.git/lfs/objects
> LocalReferenceDirs=
> TempDir=/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/git/.git/lfs/tmp
> ConcurrentTransfers=3
> TusTransfers=false
> BasicTransfersOnly=false
> SkipDownloadErrors=false
> FetchRecentAlways=false
> FetchRecentRefsDays=7
> FetchRecentCommitsDays=0
> FetchRecentRefsIncludeRemotes=true
> PruneOffsetDays=3
> PruneVerifyRemoteAlways=false
> PruneRemoteName=origin
> LfsStorageDir=/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0/git/.git/lfs
> AccessDownload=none
> AccessUpload=none
> DownloadTransfers=basic,lfs-standalone-file
> UploadTransfers=basic,lfs-standalone-file
> GIT_EXEC_PATH=/usr/lib/git-core
> GIT_CEILING_DIRECTORIES=/home/bcraddock/AGL/master/qemux86-64/tmp/work/corei7-64-agl-linux/flutter-test-texture-egl-runtimerelease/git-r0
> GIT_PREFIX=
> GIT_CONFIG_PARAMETERS='core.fsyncobjectfiles=0' 'gc.autoDetach=false'
> 'core.pager=cat'
>
> Bernard Craddock
> Co-founder Pumped Fuel
> www.pumpedfuel.com
> L2, 11 York Street Sydney 2000
>
>
>
>
>

_._,_._,_

---

   Links:

You receive all messages sent to this group.

View/Reply Online (#10084) | Reply To Group | Reply To Sender | Mute This Topic | New Topic
Your Subscription | Contact Group Owner | Unsubscribe [list-automotive-discussions82@xxxxxxxxxxx]

_._,_._,_