本篇文章主要介绍php使用snoopy类实现页面抓取的方法,感兴趣的朋友参考下,希望对大家有所帮助。
本文实例讲述了php中Snoopy类用法,具体分析如下:
这里演示了php中如何通过Snoopy抓取网页信息
/*
You need the snoopy.class.php from
http://snoopy.sourceforge.net/
*/
include("snoopy.class.php");
$snoopy = new Snoopy;
// need an proxy?:
//$snoopy->proxy_host = "my.proxy.host";
//$snoopy->proxy_port = "8080";
// set browser and referer:
$snoopy->agent = "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)";
$snoopy->referer = "http://www.jonasjohn.de/";
// set some cookies:
$snoopy->cookies["SessionID"] = '238472834723489';
$snoopy->cookies["favoriteColor"] = "blue";
// set an raw-header:
$snoopy->rawheaders["Pragma"] = "no-cache";
// set some internal variables:
$snoopy->maxredirs = 2;
$snoopy->offsiteok = false;
$snoopy->expandlinks = false;
// set username and password (optional)
//$snoopy->user = "joe";
//$snoopy->pass = "bloe";
// fetch the text of the website www.google.com:
if($snoopy->fetchtext("http://www.google.com")){
// other methods: fetch, fetchform, fetchlinks, submittext and submitlinks
// response code:
print "response code: ".$snoopy->response_code."
\n";
// print the headers:
print "Headers:
";
while(list($key,$val) = each($snoopy->headers)){
print $key.": ".$val."
\n";
}
print "
\n";
// print the texts of the website:
print "".htmlspecialchars($snoopy->results)."
\n";
}
else {
print "Snoopy: error while fetching document: ".$snoopy->error."\n";
}
总结:以上就是本篇文的全部内容,希望能对大家的学习有所帮助。
立即学习“PHP免费学习笔记(深入)”;
相关推荐:
成新网络商城购物系统
使用模板与程序分离的方式构建,依靠专门设计的数据库操作类实现数据库存取,具有专有错误处理模块,通过 Email 实时报告数据库错误,除具有满足购物需要的全部功能外,成新商城购物系统还对购物系统体系做了丰富的扩展,全新设计的搜索功能,自定义成新商城购物系统代码功能代码已经全面优化,杜绝SQL注入漏洞前台测试用户名:admin密码:admin888后台管理员名:admin密码:admin888
下载










