Re: I need help getting a web page with curl

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 10/10/21 17:14, Sam Varshavchik wrote:
ToddAndMargo via users writes:

Hi All,

Fedora 33
curl-7.76.1-12.fc34.x86_64

This page show something different in Firefox and Vivaldi
that I can get with curl.

It's quite common for a web site to inspect the headers from the web client, digest what's in the header that's sent by the client which advertise what kind of content the client claims to understand, then send the appropriate content.

So the same URL can return completely different results to curl, and to a full-featured web browser.

Looking at eraseme.html, it look like I am only
downloading the left column and not the contents
on the right side of the page

Another possibility is that the web page consists of different frames, and a separate request is needed for each frame.

What am I doing wrong?

You're trying to reinvent the wheel. This a web interface to a plain, garden variety, git repository.

Forget curl. Use git.

$ git clone https://gitlab.freedesktop.org/spice/win32/spice-nsis.git
Cloning into 'spice-nsis'…
remote: Enumerating objects: 461, done.
remote: Total 461 (delta 0), reused 0 (delta 0), pack-reused 461
Receiving objects: 100% (461/461), 89.54 KiB | 8.14 MiB/s, done.
Resolving deltas: 100% (275/275), done.
$ cd spice-nsis
$ git show | sed '1,10p'
commit f6ad44f35f5caeec51b7002169977272d85701a3
commit f6ad44f35f5caeec51b7002169977272d85701a3
Author: Sandro Bonazzola <sbonazzo@xxxxxxxxxx>
Author: Sandro Bonazzola <sbonazzo@xxxxxxxxxx>
Date:   Tue Feb 5 16:49:45 2019 +0100
Date:   Tue Feb 5 16:49:45 2019 +0100


    virtio-win: rebase on 0.164
    virtio-win: rebase on 0.164

And a little bit of scripting, or by picking the right options to "git show", to get just what you want. I'm too lazy to read git-show's man page, but there's probably a way to have it show just the commit message, and nothing else.

Anytime you want to recheck, just cd back to the same directory, do a "git pull", and see what you got.

Found something that worked:

$ curl --silent 'https://gitlab.freedesktop.org/spice/win32/spice-nsis/-/commits/master' | grep rebase

<a class="commit-row-message item-title js-onboarding-commit-item " href="/spice/win32/spice-nsis/-/commit/f6ad44f35f5caeec51b7002169977272d85701a3">virtio-win: rebase on 0.164</a>

<a class="commit-row-message item-title js-onboarding-commit-item " href="/spice/win32/spice-nsis/-/commit/d6836f79ba8deeef5b7719fd94cc208b81eb70df">virtio-win: rebase on 0.164</a>


_______________________________________________
users mailing list -- users@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe send an email to users-leave@xxxxxxxxxxxxxxxxxxxxxxx
Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: https://lists.fedoraproject.org/archives/list/users@xxxxxxxxxxxxxxxxxxxxxxx
Do not reply to spam on the list, report it: https://pagure.io/fedora-infrastructure



[Index of Archives]     [Older Fedora Users]     [Fedora Announce]     [Fedora Package Announce]     [EPEL Announce]     [EPEL Devel]     [Fedora Magazine]     [Fedora Summer Coding]     [Fedora Laptop]     [Fedora Cloud]     [Fedora Advisory Board]     [Fedora Education]     [Fedora Security]     [Fedora Scitech]     [Fedora Robotics]     [Fedora Infrastructure]     [Fedora Websites]     [Anaconda Devel]     [Fedora Devel Java]     [Fedora Desktop]     [Fedora Fonts]     [Fedora Marketing]     [Fedora Management Tools]     [Fedora Mentors]     [Fedora Package Review]     [Fedora R Devel]     [Fedora PHP Devel]     [Kickstart]     [Fedora Music]     [Fedora Packaging]     [Fedora SELinux]     [Fedora Legal]     [Fedora Kernel]     [Fedora OCaml]     [Coolkey]     [Virtualization Tools]     [ET Management Tools]     [Yum Users]     [Yosemite News]     [Gnome Users]     [KDE Users]     [Fedora Art]     [Fedora Docs]     [Fedora Sparc]     [Libvirt Users]     [Fedora ARM]

  Powered by Linux