我试图通过curl从服务器获取数据,但在授权后,我收到一个空响应。这个服务器上的站点使用AJAX来显示内容,所以首先我检查了在通过浏览器与它交互时发送的标头和查询参数。
一般头:
Remote Address:*.*.*.*:80
Request URL:http://example.com/search/search/?0.42697851033881307
Request Method:POST
Status Code:200 OK
表单数据:
QUERY:29061
QUERY_TYPE:2
QUERY_DATA:S1
PKW:X
LKW:X
FORMAT:json
LANG:ru
这是无休止的google和stackoverflow的结果:
<?php
$curl = curl_init('http://example.com/authorization/login/');
curl_setopt($curl, CURLOPT_RETURNTRANSFER, true);
curl_setopt($curl, CURLOPT_COOKIEJAR, 'cookie.txt');
curl_setopt($curl, CURLOPT_COOKIEFILE, 'cookie.txt');
curl_setopt($curl, CURLOPT_REFERER, 'http://example.com/');
curl_setopt($curl, CURLOPT_FOLLOWLOCATION, true);
curl_setopt($curl, CURLOPT_POST, true);
curl_setopt($curl, CURLOPT_POSTFIELDS, [
'LOGIN' => 'MY_LOGIN',
'PASSWORD' => 'MY_PASSWORD',
'REMEMBER' => true,
'FORMAT' => 'json',
'LANG' => 'ru'
]);
curl_exec($curl);
curl_close($curl);
$curl = curl_init('http://example.com/search/search/?0.42697851033881307');
curl_setopt($curl, CURLOPT_HEADER, true);
curl_setopt($curl, CURLOPT_RETURNTRANSFER, true);
curl_setopt($curl, CURLOPT_COOKIEJAR, 'cookie.txt');
curl_setopt($curl, CURLOPT_COOKIEFILE, 'cookie.txt');
curl_setopt($curl, CURLOPT_REFERER, 'http://example.com/');
curl_setopt($curl, CURLOPT_FOLLOWLOCATION, true);
$postFields = json_encode([
'FORMAT' => 'json',
'LANG' => 'ru',
'QUERY' => '29061',
'QUERY_TYPE' => '2',
'QUERY_DATA' => 'S1',
'PKW' => 'X',
'LKW' => 'X'
]);
curl_setopt($curl, CURLOPT_CUSTOMREQUEST, 'POST');
curl_setopt($curl, CURLOPT_POSTFIELDS, $postFields);
curl_setopt($curl, CURLOPT_HTTPHEADER, [
'X-Requested-With: XMLHttpRequest',
]);
$response = curl_exec($curl);
curl_close($curl);
var_dump($response);
下面是回应:
string(1699) "HTTP/1.1 302 Moved Temporarily
Server: nginx/1.9.2
Date: Fri, 28 Aug 2015 14:57:20 GMT
Content-Type: text/html; charset=UTF-8
Transfer-Encoding: chunked
Connection: keep-alive
X-Powered-By: PHP/5.6.10
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Set-Cookie: ci_sessions=...; expires=Sat, 27-Aug-2016 14:57:21 GMT; Max-Age=31536000; path=/; httponly
Location: http://example.com/authorization/setVkorgInfo
HTTP/1.1 302 Moved Temporarily
Server: nginx/1.9.2
Date: Fri, 28 Aug 2015 14:57:21 GMT
Content-Type: text/html; charset=UTF-8
Transfer-Encoding: chunked
Connection: keep-alive
X-Powered-By: PHP/5.6.10
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Set-Cookie: ci_sessions=...; expires=Sat, 27-Aug-2016 14:57:21 GMT; Max-Age=31536000; path=/; httponly
Set-Cookie: VKORG=5000; expires=Sat, 27-Aug-2016 14:57:21 GMT; Max-Age=31536000; path=/
Location: http://example.com/
HTTP/1.1 200 OK
Server: nginx/1.9.2
Date: Fri, 28 Aug 2015 14:57:21 GMT
Content-Type: application/json; charset=utf-8
Transfer-Encoding: chunked
Connection: keep-alive
X-Powered-By: PHP/5.6.10
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Set-Cookie: ci_sessions=...; expires=Sat, 27-Aug-2016 14:57:22 GMT; Max-Age=31536000; path=/; httponly
{
"status": true,
"arr_messages": [],
"data": []
}"
当我通过浏览器检索数据时,我在Chrome的控制台中看到"data":数组中具有所需数据的对象,但在我的脚本中它是空的。我的请求有什么问题吗?
以下是截图:http://joxi.ru/XEA48NSQozPAbz
如果我发送错误的参数,我得到这个:
{
"status": false,
"arr_messages": [
{
"id": "123456",
"login": "MY_LOGIN",
"type": "E",
"text": "Error inputs",
"date": "2015-08-28 22:24:20"
}
],
"data": []
}
因此,如果我得到status: true和空"arr_messages",那么我正在发送正确的请求。
UPD:获取内容的AJAX函数:
var getApiAjax=function(url, req, callback, errorcallback, async)
{
if(typeof(errorcallback)=="undefined")
{
errorcalback=function(){return false;}
}
if(typeof(async)=="undefined")
{
async=true;
}
req.FORMAT = "json";
req.LANG = "ru";
var xhr=$.ajax(
{
url: url+"?"+Math.random(),
type: "POST",
data: req,
async: async,
dataType: "json",
success: function(resp)
{
var showMes = true;
if( spinnerModal.isShowSpinner() ){
spinnerModal.hidePleaseWait();
showMes = false;
}
if( typeof resp.arr_messages != "undefined" && resp.arr_messages.length ) {
if (resp.status) {
showMessage( resp.arr_messages, callback, resp );
} else {
showMessage( resp.arr_messages, errorcallback, resp );
}
if(showMes) informModal.showMessage();
} else {
if (resp.status) {
callback( resp );
} else {
errorcallback( resp )
}
}
},
error: function(msg)
{
var arr_messages = new Array();
if( spinnerModal.isShowSpinner() ) spinnerModal.hidePleaseWait();
if( typeof msg == "string" )
{
arr_messages.push( { 'text' : msg, 'type' : 'E' } );
showMessage( arr_messages, errorcallback, msg, true );
}
else
{
errorcallback();
}
}
});
return xhr;
};
我可以从浏览器的控制台中调用这个函数并得到我想要的结果
getApiAjax("/search/search/",{
'QUERY' : "29061",
'QUERY_TYPE' : "2",
'QUERY_DATA' : "S1",
'PKW' : "X",
'LKW' : "X"
})
截图:http://joxi.ru/WL211LSbgN42Xq
所以我不知道curl请求有什么问题:(
原来这么简单!我不知道为什么,但这个网站不检查搜索查询的cookie。当一个人打开这个网站时,他只能看到登录表单,没有其他东西,所以如果访问者是一个人,他必须授权才能访问这个网站,之后访问者才能使用网站的服务,包括搜索。所以我决定我的脚本需要授权。经过一个不眠之夜,我想"如果我未经授权请求会发生什么"(我实际上想看到一些错误消息来处理),所以我扔掉了我的脚本的第一部分:
$curl = curl_init('http://example.com/authorization/login/');
curl_setopt($curl, CURLOPT_RETURNTRANSFER, true);
curl_setopt($curl, CURLOPT_COOKIEJAR, 'cookie.txt');
curl_setopt($curl, CURLOPT_COOKIEFILE, 'cookie.txt');
curl_setopt($curl, CURLOPT_REFERER, 'http://example.com/');
curl_setopt($curl, CURLOPT_FOLLOWLOCATION, true);
curl_setopt($curl, CURLOPT_POST, true);
curl_setopt($curl, CURLOPT_POSTFIELDS, [
'LOGIN' => 'MY_LOGIN',
'PASSWORD' => 'MY_PASSWORD',
'REMEMBER' => true,
'FORMAT' => 'json',
'LANG' => 'ru'
]);
curl_exec($curl);
curl_close($curl);
并在浏览器中启动它。接下来我看到的让我震惊)))
string(2856) "HTTP/1.1 100 Continue
HTTP/1.1 200 OK
Server: nginx/1.9.2
Date: Sat, 29 Aug 2015 05:38:54 GMT
Content-Type: application/json; charset=utf-8
Transfer-Encoding: chunked
Connection: keep-alive
X-Powered-By: PHP/5.6.10
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Set-Cookie: ci_sessions=.....; expires=Sun, 28-Aug-2016 05:38:55 GMT; Max-Age=31536000; path=/; httponly
{
"status": true,
"arr_messages": [],
"data": {
"ARTIDINFO": {
"203653": {
"ARTID": "203653",
"PIN": "29061",
"BRAND": "...",
"NAME": "...",
"IMG": "0",
"NAMEP": []
},
"301175": {
"ARTID": "301175",
"PIN": "29061",
"BRAND": "...",
"NAME": "...",
"IMG": "1",
"NAMEP": []
},
"1696433": {
"ARTID": "1696433",
"PIN": "29061",
"BRAND": "...",
"NAME": "...",
"IMG": "1",
"NAMEP": []
}.....
现在我不明白为什么服务器在没有授权的情况下发送数据给我,而当我通过授权时不发送数据O_o