Hi. This isn't a Fed isue, but I am using a fed system to run the curls!!! Not sure if this is appropriate to the group/thread, but I'm flumoxed. I'm trying to replicate the process for the FF/chrome browser to generate the data for the final page. The target site is fairfied.edu, class data. The basic process, is : 1) get term 2) get subject 3) generate the class data I've crafted curl (cmdline) statements to generate step 1/2. Step 3 is where I run into issues. One can go to the browser, implement firebug (or livehttpheaders/etc..) to track the cookies/referrer/headers.. The target site/url is: https://xessprod.fairfield.edu/FFPRODStudentRegistrationSsb/ssb/term/termSelection?mode=search The 1st page (term) you select the term in the term select dialog. This invokes a dynamic process which is the "get" to generate the term list. Using the "term" (summer 2017), and then selecting the "submit" generates the "subject" page. Again, selecting the "subject" dialog invokes the dynamic process to fill in the sub sel dialog. Selecting the subj "submit" uses both the term, as well as the subj, and then generates the assoicated class page. For the curl: To generate the termlist: terms:: curl -sS -A "Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Firefox/38.0" --cookie-jar aa.lwp --cookie aa.lwp -L 'https://xessprod.fairfield.edu/FFPRODStudentRegistrationSsb/ssb/classSearch/getTerms?searchTerm=&offset=1&max=100&_=1495062777183' subj:: curl -sS -A "Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Firefox/38.0" --cookie-jar aa.lwp --cookie aa.lwp -L 'https://xessprod.fairfield.edu/FFPRODStudentRegistrationSsb/ssb/classSearch/get_subject?searchTerm=&term=201705&offset=1&max=100&_=1495062824646' try for class:: curl -v -sS -A "Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Firefox/38.0" --cookie-jar aa.lwp --cookie aa.lwp -L 'https://xessprod.fairfield.edu/FFPRODStudentRegistrationSsb/ssb/searchResults/searchResults?txt_subject=AC&txt_term=201705&startDatepicker=&endDatepicker=&pageOffset=0&pageMaxSize=10&sortColumn=subjectDescription&sortDirection=asc' The curl for the class is screwing up and not generating the required output. As far as I can tell, it seems that it should work, but I'm missing some step that the browser is doing... The output for each step/curl is json In a browser, entering each of the following shoud work. However, the term/subj urls work, with the class url failing... terms https://xessprod.fairfield.edu/FFPRODStudentRegistrationSsb/ssb/classSearch/getTerms?searchTerm=&offset=1&max=10&_=1495062777183 subj https://xessprod.fairfield.edu/FFPRODStudentRegistrationSsb/ssb/classSearch/get_subject?searchTerm=&term=201705&offset=1&max=10&_=1495063116089 class https://xessprod.fairfield.edu/FFPRODStudentRegistrationSsb/ssb/searchResults/searchResults?txt_subject=AC&txt_term=201705&startDatepicker=&endDatepicker=&pageOffset=0&pageMaxSize=10&sortColumn=subjectDescription&sortDirection=asc Any thoughts/comments to point to my "doh" moment!! thanks ps, the headers from the browser are:: response header:: Cache-Control no-cache, no-store Content-Type application/json;charset=UTF-8 Date Wed, 17 May 2017 23:45:09 GMT Expires -1 Server Apache-Coyote/1.1 Set-Cookie BNI_BARRACUDA_LB_COOKIE=0000000000000000000000000f090d0a0000bb01; Path=/; HttpOnly Transfer-Encoding chunked X-Frame-Options DENY x-ua-compatible IE=edge request header:: Accept application/json, text/javascript, */*; q=0.01 Accept-Encoding gzip, deflate Accept-Language en-US,en;q=0.5 Connection keep-alive Cookie JSESSIONID=6DC2BB4A00F547220A0B1E7AA758D557;BNI_BARRACUDA_LB_COOKIE=0000000000000000000000000f090d0 a0000bb01 Host xessprod.fairfield.edu Referer https://xessprod.fairfield.edu/FFPRODStudentRegistrationSsb/ssb/classSearch/classSearch User-Agent Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Firefox/45.0 X-Requested-With XMLHttpRequest X-Synchronizer-Token ae671d70-4f86-4c4f-8d86-4ffe5275de50 _______________________________________________ users mailing list -- users@xxxxxxxxxxxxxxxxxxxxxxx To unsubscribe send an email to users-leave@xxxxxxxxxxxxxxxxxxxxxxx