用Curl模拟ajax调用

我正在使用curl (通过PHP)抓取一个站点，我想要的一些信息是一个产品列表，默认情况下只显示前几个产品。当用户单击一个按钮获取完整的产品列表时，其余部分将传递给用户，这将触发一个ajax调用来返回该列表。

简单地说，他们使用的JS：

代码语言：javascript复制headers['__RequestVerificationToken'] = token;

$.ajax({

type: "post",

url: "/ajax/getProductList",

dataType: 'html',

data: JSON.stringify({ historyPageIndex: 1, displayPeriod: 0, productsType: All }),

contentType: 'application/json; charset=utf-8',

success: function (result) {

$(target).html("");

$(target).html(result);

},

beforeSend: function (XMLHttpRequest) {

if (headers['__RequestVerificationToken']) {

XMLHttpRequest.setRequestHeader("__RequestVerificationToken", headers['__RequestVerificationToken']);

}

}

});下面是我的PHP脚本：

代码语言：javascript复制curl_setopt($ch, CURLOPT_USERAGENT, $userAgent);

curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);

curl_setopt($ch, CURLOPT_FOLLOWLOCATION, true);

curl_setopt($ch, CURLOPT_MAXREDIRS, 10);

curl_setopt($ch, CURLOPT_COOKIEFILE, $cookieLocation);

curl_setopt($ch, CURLOPT_COOKIEJAR, $cookieLocation);

curl_setopt($ch, CURLOPT_POST, false);

curl_setopt($ch, CURLOPT_URL, 'https://www.domain.com/Applications/ViewProducts');

curl_setopt($ch, CURLOPT_REFERER, 'https://www.domain.com/');

$webpage = curl_exec($ch);

$productsType = trim(find_by_pattren($webpage, '

$token = trim(find_by_pattren($webpage, '

$postVariables = 'productsType='.$productsType.

'&historyPageIndex=1

&displayPeriod=0

&__RequestVerificationToken='.$token;

curl_setopt($ch, CURLOPT_POST, true);

curl_setopt($ch, CURLOPT_POSTFIELDS, $postVariables);

curl_setopt($ch, CURLOPT_URL, 'https://www.domain.com/ajax/getProductList');

curl_setopt($ch, CURLOPT_REFERER, 'https://www.domain.com/Applications/ViewProducts');

$webpage = curl_exec($ch);这将生成站点的错误页面。我认为主要原因可能是：

他们检查它是否是ajax请求(不知道如何修复)标记需要在标头中，而不是在post变量中。

有什么想法吗？

编辑:这是工作代码：

代码语言：javascript复制curl_setopt($ch, CURLOPT_USERAGENT, $userAgent);

curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);

curl_setopt($ch, CURLOPT_FOLLOWLOCATION, true);

curl_setopt($ch, CURLOPT_MAXREDIRS, 10);

curl_setopt($ch, CURLOPT_COOKIEFILE, $cookieLocation);

curl_setopt($ch, CURLOPT_COOKIEJAR, $cookieLocation);

curl_setopt($ch, CURLOPT_URL, 'https://www.domain.com/Applications/ViewProducts');

curl_setopt($ch, CURLOPT_REFERER, 'https://www.domain.com/');

$webpage = curl_exec($ch);

$productsType = trim(find_by_pattren($webpage, '

$token = trim(find_by_pattren($webpage, '

$postVariables = json_encode(array('productsType' => $productsType,

'historyPageIndex' => 1,

'displayPeriod' => 0));

curl_setopt($ch, CURLOPT_POST, true);

curl_setopt($ch, CURLOPT_HTTPHEADER, array("X-Requested-With: XMLHttpRequest", "Content-Type: application/json; charset=utf-8", "__RequestVerificationToken: $token"));

curl_setopt($ch, CURLOPT_POSTFIELDS, $postVariables);

curl_setopt($ch, CURLOPT_URL, 'https://www.domain.com/ajax/getProductList');

curl_setopt($ch, CURLOPT_REFERER, 'https://www.domain.com/Applications/ViewProducts');

$webpage = curl_exec($ch);