logo
Sign In

Brained Search Xng Jina OR

tool

Smart SearXNG Search with Jina scraper and OpenRouter

cernunnos
@cernunnos
·
a year ago
31
0
1.5K
Updated a year ago
Created Nov 16, 2025
brained_search_xng_jina_or.py
Python · 1077 lines
"""
title: Smart Search Xng with Jina scraper
author: Lug, scraper part from Web search v0.2.1 by siwadon
author_url: https://brainedai.netlify.app
description: An advanced search tool that uses 2 LLMs to perform URL selection and content extraction. Returns only the most relevant information.
required_open_webui_version: 0.6.0
requirements: aiohttp, asyncio, requests, beautifulsoup4
version: 0.9.3
license: MIT
"""

import json

https://brainedai.netlify.app/en/tools/web-search/brained-search/

Version 0.9.3

A tool specially designed for BDS agent, but work well for any agent.

This tool works in four steps:
Step 1: It searches the internet using a few keywords (query)
Step 2: LLM 1 selects the URLs to scrape based on a query related to the search cycle (query_2)
Step 3: It scrapes the URLs selected by LLM 1
Step 4: LLM 2 selects interesting information from scraped pages based on a query related to the cycle (query_2)

Important:
You need to have a local SearXNG server.
The minimum parameters to enter are the API keys for OpenRouter.
If you put a LangSearch API key (free) you will have a solid 2nd fallback (first fallback is DDGS).

If you don’t want to install a local SearXNG server, use Brained Search DDGS.

This one uses Jina Scraper (cloud).

The function of this tool is: smart_search

A special version for OpenRouter that allows you to configure fallback models and prioritize providers using a list (provider IDs are separated by commas without spaces) or by enabling “Llm 2 Enable Throughput Sort.” If you enable this option, you disable the list of providers to prioritize and enable prioritization based on throughput, and you also enable the ability to disable providers that are too expensive (fast but expensive).
https://openrouter.ai/docs/features/provider-routing

0