Gitea Repository Scraper

tool

Scrape the content of a Gitea repository and return it to the LLM Context.

pakobbix
@pakobbix
·
2 years ago
126
2
1K
Updated 2 years ago
Created Apr 27, 2025
gitea_repository_scraper.py
Python · 140 lines
"""
title: Gitea repository scraper
description: Scrape the content of a Gitea repository and return it to the LLM Context.
author: Pakobbix
author_url: zephyre.one
github:
funding_url:
version: 0.2.1
license: MIT
"""

"""

Gitea Repository Scraper

Overview

The Gitea Repository Scraper is a tool designed to scrape the content of a Gitea repository and return it to the LLM (Large Language Model) Context. This allows users to integrate their Gitea repositories with an LLM, providing an overview or knowledge base from the repository's content.

Features

  • Repository Content Scraping: Fetch all text files from a specified Gitea repository.
  • Progress and Error Updates: Real-time updates on the progress and any errors encountered during the scraping process.
  • Integration with Open-WebUI: Designed to work seamlessly with Open-WebUI for LLM integration.

1