web-crawling web 中文意思是什麼
web-crawling web
解釋
爬行遍歷-
It implements web crawling through distributed technology, and builds index database through accidence analyzing chinese characters separating unuseful words deleting etyma extracting index words selecting and lexicon. the level system uses new model of web accessing and level computation to build web level system so that the requirement for computer resources is greatly reduced
該搜索引擎使用分散式技術實現網頁獲取模塊；通過詞法分析、中文分詞、無用詞匯刪除、詞干提取、索引詞條選擇和詞典等技術建立索引數據庫；該搜索引擎的級別系統使用了新的網路訪問模型和級別計算模型，大大降低了搜索引擎對于計算機資源的要求。 -
Through deep study of search engine ' s core technology, such as web crawling index building level system index searching, this paper designs and implements a new search engine
本文在深入分析網頁獲取、索引生成、級別系統、索引檢索等搜索引擎核心技術的基礎上，設計並實現了一種新的搜索引擎。 -
On incremental crawling module, according to the rapid updating frequency of news web sites, this paper adopts a way of mining time information of web pages. it makes use of the time information of pages to decrease the times of crawling web pages and searching in databases. thus we have efficiently solved the problem of incremental crawling the web sites with high updating frequency, and new web pages can be obtained in good time by users
本文在對增量採集技術說明中，針對諸如大型新聞門戶網站更新頻率快的特點，採用了網頁的時間挖掘方法，通過對更新時間的考察，減少了下載網頁的次數以及在數據庫中查找的次數，比較有效的解決了對更新頻率快的網站增量下載的問題，並使新出現的網頁能夠及時的被用戶查找到。 -
Combining cluster - based parallel processing technology with the demanding requirement of crawling through vast amount web information, this architecture demonstrates a reasonable trade - off in crawling strategy, communication reduction, load balancing, task scheduling, and granularity control
結合web信息搜集的基本要求和基於pc機群的并行分佈處理技術，該系統結構力圖在搜集策略、可擴展性、減少通信、負載平衡、任務調度、并行粒度控制等方面得到一個很好的折衷。 -
Generation. for example, the massive and efficient web - crawling technology, the method of hyper - link analysis, and the user behavior analyzing technology will be described in detail. in addition, it is also presented the recent research progress of webgather, which is a typical search engine of 3
論述了三代搜索引擎的發展，著重介紹了第三代搜索引擎的體系結構，詳細討論了該搜索引擎的幾個核心技術大規模搜集技術超鏈分析技術和用戶行為分析技術。
分享友人