Tracker: Search & Research Implementation Improvements

[rmusser01]

This issue is to track improvements regarding the Search & Research Pipeline in the project.

• Implementation of search and review pipeline
• Implementation of search multiple providers
• implementation of advanced search options
• Implementation of advanced search options changing depending on selected search provider
• implementation of model-specific queries
• implementation of saved search analysis reports
• implementation of option to save crawled web pages to DB
• implementation of option for Image/Video search/display
• Option for recurring search & analysis with additional option for saving to DB/Temporary file/external file issue Feature Addition: Repeating web scraping on defined schedule + Rerank & review #462
• Display of follow up questions/queries based off original query + analysis result
• Option to continually generate/cycle through sub-query batches until satisfied/modify sub-queries before being sent.
• Implementation of Re-ranking of results
• Check for total text length before performing summarization to prevent unnecessary/silly performance of
• Sampler settings? - Mindsearch (though could just be their KG)
• Implementation of Continuous Search -> Report -> Follow up Q -> Report -> Follow up Q -> etc.
• Option to user to select which items are relevant/skip LLM check
• Option to user to add relevant items to existing set