Search Engine Monitor

Web based PHP/MySQL/Smarty application to do the following: Register a user with an email address. Accept input for up to 5 keyword phrases (KWP). Store the KWPs in a database. Perform a baseline search on each KWP. Save baseline search for future comparison. Notify user of KWP search results. Display search results when user returns to/logins website. Continue to perform searches on KWPs at selected intervals (days) and save any new search results or previous search results that no longer appear. Notify user via email of changes in search results. Display updated results when user returns to website. More detailed specs will be negotiated when project is awarded. This application is Version 1. If successful, it will be expanded in functionality and scale with subsequent projects. ## Deliverables 1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done. 2) Deliverables must be in ready-to-run condition, as follows (depending on the nature of the deliverables): a) For web sites or other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment. b) For all others including desktop software or software the buyer intends to distribute: A software installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request. 3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement). * * *This broadcast message was sent to all bidders on Thursday Jan 26, 2006 9:06:58 AM: 1/25-Amendments based on coder questions. - The purpose of this application is to allow a person to keep track of the additions and deletions to search engine listings for target key word phrases. Imagine you own the business SuperCoder and your work exclusively on Smarty, PHP and MySQL. Your top competitors are OKCoder and PsuedoCoder. You might use this application to keep track of who/what/where is showing up on the major search engines. You create an account and enter the following terms - SuperCoder - because you want to be notified if the search engine finds or loses any pages that have SuperCoder on them. This would let you know if someone else was using your name or talking about you in a blog. - 'Smarty + PHP + MySQL' - because you'd want to know about any new webpages that the search engine found with these terms - maybe a new technical article - or per haps it dropped an article you wrote from it's listings. - OKCoder (and PsuedoCoder) - because you want to keep an eye on what your competitors are doing and be notified of any press releases or new blog/technical articles that they have written. It would also notify you when a previous listing had been dropped from the search engine listings. - a baseline search defines the current search listings for future comparison. THe intent of the application is to notify the user of any additions or deletions to the search listings. Therefore, a baseline of SERPs is needed to perform subsequent comparisons to notify the user. - the frequency of comparisons will be variable based on the type of account a user has. Expect weekly comparisons for free users and daily comparisons for paid users. A cron job can be created to kickoff the comparison routine and the load of all the weekly users needs to be spread somewhat evenly over the 5 busine ss days of the week so that the script doesn't time out and G doesn't get upset about over-using their search capabilities. It would be wise to spread the search engine queries as evenly as possible over the day as well so the app doesn't get banned from the search engine. - Google will be the first and only search engine to be searched in this version. In future versions, expect to add additional meta search engines to increase the search coverage. - In the first version, it will be OK to only baseline and then evaluate the first 10 search listings but future versions, especially paid users, will need the ability to baseline and then compare against up to the first 100 search engine listings. - the user data that needs to be stored needs to email, account type (free, paid), date of last update. - the search listing data that needs to be stored needs to be sufficient to tell if there are new search engine listings or if a previous sea rch engine listing has been dropped. It's probably sufficient to only keep track of the target URL and date of last change (Google shows this data on its search results in green). - I will setup the cron job and would expect to have one that runs M-F on the hour from 7AM to 6PM. It should call a single function and that function should determine which users to run the evaluation for. BTW, I've done this before and if there is a lot of work to be done after the function is called, it's possible for the script to time out. When that is possible, I've found it worthwhile to have the function writeout shell script files that call another function with command line args specific to process each individual user and then use the exec() function to minimize the load and prevent script timeout. Sample code is listed below - foreach($arrPubs as $sID){ // loop to write & exec shell files $iShellFileInterval=0; $clPub=new classNewsPub($sID); $sExe cFile = CONST_LOG_DIRECTORY.'onetime_MOVE_PUBS_TO_CHEAP_SERVER_'.$sID.'.sh'; $sCmd = "#!/bin/bash\n php -f /var/www/farm/[login to view URL] CLI=TRUE OBJECT=WEBSITE ACTION=MOVE_PUB_TO_CHEAP_SERVER PUB_ID=".$sID." SITE_ID=".$sSiteID."\n rm -f ".$sExecFile; $bRetVar=logWrite($sExecFile, $sCmd, FALSE,'w+b'); chmod ($sExecFile, 0777); // exec the shell script exec("at -f$sExecFile now + ".$iShellFileInterval." minutes"); $iShellFileInterval+=1; $iCnt++; } ## Platform Redhat ES, MySQL, PHP 4.X, Smarty Templates