Need of Securing Migrating Crawling Agent, Remote Platform and the Data Collection

Using migrating (mobile) crawling agents, the process of selection and filtration of web documents can be done at web servers rather than search engine side, which reduces network load caused by the web crawlers. The mobile code from search engine side transfers and executes on web servers, an environment controlled by another party, it gives rise to several security issues in mobile agent computing like integrity of mobile agents and their authentication, authorization, intrusion detection etc. Because of mobility of mobile agent, the security problems have become more complicated and a bottleneck in the development and maintenance of mobile agent technology. This paper presents use of migrating crawling agents in designing search engines, and need of maintaining integrity and security of free roaming agents, the remote platform where they execute and data they carry.