PHP跟踪页面中的每个链接和链接上的每个链接 - PHP go after each link in page and links on links

PHP go after each link in page and links on links

本文关键字：链接跟踪 PHP | 更新日期: 2023-09-27

我有一个函数，从一个给定的页面使用php正则表达式返回链接，现在我要在找到的每个链接后面加上....

下面是我的代码

function getLinks($url){
$content = file_get_contents($url);
preg_match_all("|<a [^>]+>(.*)</[^>]+>|U", $content, $links, PREG_PATTERN_ORDER);
$l_clean = array();
foreach($links[0] as $link){
        $e_link = explode("href",$link);
        $e_link = explode("'"",$e_link[1]);
        $f_link = $e_link[1];
        if( (substr($f_link,0,strlen('javascript:;')) != "javascript:;")){
            $sperator = "";
            $first = substr($f_link,0,1);
            if($first != "/"){
                $f_link = "/$f_link";
            }
            if(substr($f_link,0,7) != "http://"){
                $f_link = "http://" . $sperator . $_SERVER['HTTP_HOST'] . $f_link;              
            }
            $f_link = str_replace("///","//",$f_link);
            if(!in_array($f_link, $l_clean)){
                array_push($l_clean , $f_link);
            }
    }
}
}

只需递归地执行，并设置深度终止:

function getLinks($url, $depth){
    if( --$depth <= 0 ) return;
    $content = file_get_contents($url);
    preg_match_all("|<a [^>]+>(.*)</[^>]+>|U", $content, $links, PREG_PATTERN_ORDER);
    $l_clean = array();
    foreach($links[0] as $link){
            $e_link = explode("href",$link);
            $e_link = explode("'"",$e_link[1]);
            $f_link = $e_link[1];
            if( (substr($f_link,0,strlen('javascript:;')) != "javascript:;")){
                $sperator = "";
                $first = substr($f_link,0,1);
                if($first != "/"){
                    $f_link = "/$f_link";
                }
                if(substr($f_link,0,7) != "http://"){
                    $f_link = "http://" . $sperator . $_SERVER['HTTP_HOST'] . $f_link;              
                }
                $f_link = str_replace("///","//",$f_link);
                if(!in_array($f_link, $l_clean)){
                    array_push($l_clean , $f_link);
                    getLinks( $f_link, $depth );
                }
        }
    }
}
$links = getLinks("http://myurl.com", 3);