關於數據採集的問題
0
悬赏园豆：5
[已关闭问题]
大家對數據採集有什麽心得？
我現在要採集這個網站，
通過IE打開是正常的，源碼也可以看到。但是就是用程序採集就得不到其中某部份的數據了。
我核心程序是：
public static string GetOpenReadHTML(string url)
{
try
{
string strValue = "";
using (WebClient wt = new WebClient())
{
using (Stream stream = wt.OpenRead(url))
{
Encoding encoding = Encoding.GetEncoding("utf-8");
using (StreamReader streader = new StreamReader(stream, encoding))
{
strValue = streader.ReadToEnd();
strValue = strValue.Replace("\r", "");
strValue = strValue.Replace("\t", "");
strValue = strValue.Replace("\n", "");
Thread.Sleep(200);
}
}
}
return strValue;
}
catch
{
return "";
}
}
public static string GetOpenReadHTML(string url)
{
try
{
string strValue = "";
using (WebClient wt = new WebClient())
{
using (Stream stream = wt.OpenRead(url))
{
Encoding encoding = Encoding.GetEncoding("utf-8"); using (StreamReader streader = new StreamReader(stream, encoding))
{
strValue = streader.ReadToEnd();
strValue = strValue.Replace("\r", ""); strValue = strValue.Replace("\t", ""); strValue = strValue.Replace("\n", "");
Thread.Sleep(200);
}
}
}
return strValue;
}
catch
{
return "";
}
}
高手幫忙看下，擺脫~
