Open Source Python Internet Software

grab-site is an open source web crawling tool designed to archive and back up websites by recursively downloading their content. It works by taking a starting URL and systematically following links across the site, capturing pages and resources and saving them into WARC archive files for long-term preservation. Internally, the crawler uses a fork of the wpull engine to fetch and process web pages efficiently during large-scale crawls. grab-site includes a built-in dashboard that displays real-time crawl activity, including which URLs are currently being processed and how many remain in the queue. Users can dynamically apply ignore patterns during an active crawl, allowing them to skip problematic or unnecessary URLs that could slow down or block the archiving process. grab-site also provides predefined ignore sets for common site structures such as forums and other complex web platforms. Additional mechanisms like duplicate page detection help avoid re-crawling identical content.

BitTorrent is a tool for distributed download. Go to http://www.bittorrent.com/ for the latest version, or http://www.bittorrent.com/dl/?C=M;O=D for source and older versions.

Videodl is a lightweight video downloader implemented entirely in Python that allows users to retrieve videos from a wide range of online media platforms. It focuses on providing a fast and simple way to parse video pages and download media files, often prioritizing high-definition versions without watermarks when available. It supports numerous video platforms across both Chinese and international streaming ecosystems, enabling users to fetch content from many popular services through a unified interface. Videodl works by implementing platform-specific client modules that extract video information and download links from supported services. Videodl can integrate with external command-line utilities to improve downloading performance, handle streaming formats such as HLS, and manage encrypted or segmented media streams. Additional utilities can also enable faster downloads, resume interrupted transfers, and process complex playlist structures.

weibo-crawler is a Python-based data collection tool designed to retrieve information from Sina Weibo user accounts. It automates the process of gathering posts, user profile details, and engagement metrics from one or more target accounts. weibo-crawler can extract comprehensive information about users, including profile attributes such as nickname, follower count, following count, and account metadata. It also captures detailed data about each post, including the content, publishing time, topics, mentions, likes, reposts, and comments. In addition to textual data, the project can download original media from posts, such as images, videos, and Live Photo content. Collected data can be exported to structured formats such as CSV or JSON or stored in databases for further analysis and research. It supports incremental crawling so users can periodically collect only newly published posts, making it useful for ongoing monitoring or dataset updates.

HTMLArea 4 is a browser based WYSIWYG editor that easily replaces the TEXTAREA in your web pages. It is written in JavaScript, and suitable for use in any modern web browser, and any page on your web site. Current version is 4.0-2016-08-29

The best of Chromium and Ubuntu. Cub Linux is a project to replicate the Chromium OS experience on an Ubuntu Linux base system. Cub Linux is free to download and use forever.

Manage node sets, node groups and execute commands on cluster nodes in parallel. Provides an event-based Python library to improve administration of large compute clusters or server farms. Command line tools: clush and nodeset included.

For PHP 5.6 - 8.4.X see: Ascoos Web Extended Studio (AWES) is here : https://sourceforge.net/projects/ascoos-web-extended-studio/ ASCOOS Web Server is a rich package designed as a versatile web server for development purposes. It incorporates third-party components such as PHP, MySQL, pgSQL, MongoDB and FileZilla and stands out through a compact setup and a well-built administrative panel. ASCOOS Web Server allows you to work with multiple versions of PHP and MySQL without having to re-install the package. In other words, it is possible to accommodate the newest versions of the components without removing the previous ones. Needless to say, this brings great advantage to developers who want to test their application on several editions of PHP and MySQL.

Ascoos Web Extended Studio (AWES) is a portable, free 64-bit web server environment for Windows, designed for professional web developers and designers who need flexibility, modularity, and multi-version testing capabilities. It provides a complete local development stack based on technologies such as Apache, PHP, Node.js, Python, MariaDB, MongoDB, FileZilla, and other essential tools. 🔧 Key Features: - Multi-version support for PHP and MariaDB - Modular and upgrade-friendly architecture - Fully portable – no installation required - Integrated tools and applications - Advanced GUI features - CGI technology support 🎯 Ideal for: - Developing and testing PHP applications across multiple environments - Experimenting with different software versions - Maintaining legacy projects - Local development and training without installation Official Site: https://awes.ascoos.com Demo video: https://youtu.be/HMCJpgEC9zg GitHub: https://github.com/ascoos/awes

Grail is a web browser written in Python using the Tk widget set. It is designed to be highly extensible, allowing the user to extend the ste of content types that are supported. Grail is now being developed by visual-101.

Apache2 VirtualHost Python is a very simple and powerfull app for create Virtuals Host on Apache Server. Created with Python3, Apache VirtualHost Python is a very compatibly with your OS.

HTSQL is an HTTP access library to SQL databases, at http://htsql.org -- it is implemented with Python, and initially uses the PostgreSQL database. It has a do-as-you-please BSD style license for use with open source databases.

Konsep is a CMS application and site builder for Microsoft .NET/ISS as well as Mono/Apache.

Midnight Xen is a project to finish the Xen project manager for zope. We also intend to implement Gantt and Pert Chart features. The first priority is to make a build that works right on improt into Zope and then re-initiate the security later.