Version 0.9.3, it can scrape arxiv paper (HTML or PDF) and other improvements.

A tool specially designed for BDS agent, but work well for any agent.

This tool works in four steps: Step 1: performs three searches on Searxng in parallel (“query_1” “query_2” and “query_3”) Step 2: For each query independently, LLM 1 selects a defined number of URLs from those in the searxng response based on “long_query” if it exists, otherwise based on “query_x” Step 3: The selected URLs are scraped by a cloud scraper (Jina) for query 1 and by an internal scraper (beautifulsoup) for queries 2 and 3; if for queries 2 and 3 there are URLs ending in .pdf, they are sent to the Jina scraper (because beautifulsoup cannot scrape PDFs) Step 4: The pages scraped by Jina from query 1 and those scraped by BeautifulSoup from queries 2 and 3 are sent together to LLM 2, which selects the interesting information based on “long_query”.

The default LLM 2 is fast and free, but if you are doing scientific or complicated research, I recommend using an LLM such as Deepseek V3.2 or Kimi K2 Thinking (for deepseek you can activate “Llm 2 Enable Reasoning”).

Jina scraper without Jina API key scrapes 2 URLs at the same time. With Jina API key, it scrapes 5 URLs at the same time.

The main function of this tool is: three_smart_searches (3 query at same time)

The two additional functions: summarize_url: scrapes and summarizes web pages scrape_url: scrapes only web pages.

Important: You need to have a local SearXNG server. The minimum parameters to enter are the API keys for OpenRouter (for LLM 1 and for LLM 2). If you put a LangSearch API key (free) you will have a solid 2nd fallback (the first is DDGS (free)).

If you don’t want to install a local SearXNG server, use Three Brained Search LangSearch.

A special version for OpenRouter that allows you to configure fallback models and prioritize providers using a list (provider IDs are separated by commas without spaces) or by enabling “Llm 2 Enable Throughput Sort.” If you enable this option, you disable the list of providers to prioritize and enable prioritization based on throughput, and you also enable the ability to disable providers that are too expensive. https://openrouter.ai/docs/features/provider-routing