Skip to content

Navigation Menu

Appearance settings

hplt-project

GitHub Copilot
Write better code with AI

GitHub Spark New
Build and deploy intelligent apps

GitHub Models New
Manage and compare prompts

GitHub Advanced Security
Find and fix vulnerabilities

Actions
Automate any workflow
Codespaces
Instant dev environments

Issues
Plan and track work

Code Review
Manage code changes

Discussions
Collaborate outside of code

Code Search
Find more, search less
Explore

Why GitHub

Documentation

GitHub Skills

Blog
Integrations

GitHub Marketplace

MCP Registry
View all features
By company size

Enterprises

Small and medium teams

Startups

Nonprofits
By use case

App Modernization

DevSecOps

DevOps

CI/CD

View all use cases
By industry

Healthcare

Financial services

Manufacturing

Government

View all industries
View all solutions
Topics

AI

DevOps

Security

Software Development

View all
Explore

Learning Pathways

Events & Webinars

Ebooks & Whitepapers

Customer Stories

Partners

Executive Insights
GitHub Sponsors
Fund open source developers
The ReadME Project
GitHub community articles
Repositories

Topics

Trending

Collections
Enterprise platform
AI-powered developer platform
Available add-ons

GitHub Advanced Security
Enterprise-grade security features

Copilot for business
Enterprise-grade AI features

Premium Support
Enterprise-grade 24/7 support
Pricing

Search code, repositories, users, issues, pull requests...

Search

Clear

Search syntax tips

Provide feedback

We read every piece of feedback, and take your input very seriously.

Include my email address so I can be contacted

Saved searches

Use saved searches to filter your results more quickly

Name

Query

To see all available qualifiers, see our documentation.

Appearance settings

You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session.

Dismiss alert

HPLT - High Performance Language Technologies

A space that combines petabytes of natural language data with large-scale model training

43 followers
http://hplt-project.org
@hplt_eu

Overview
Repositories
Discussions
Projects
Packages
People

More

Overview
Repositories
Discussions
Projects
Packages
People

Pinned Loading

OpusCleaner OpusCleaner Public

OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.

Python 51 15
OpusTrainer OpusTrainer Public

Curriculum training

Python 18 6

Repositories

Loading

Type

Select type

All Public Sources Forks Archived Mirrors Templates

Language

Select language

All C++ HTML JavaScript Jupyter Notebook PHP Python Rust Shell

Sort

Select order

Last updated Name Stars

Showing 10 of 26 repositories

warc2text-runner Public
Scripts for parallelized extraction of plain texts from WARC archieves. Aiming at common and reproducible extraction approach.

hplt-project/warc2text-runner’s past year of commit activity

Jupyter Notebook 4 1 5 0 Updated Sep 29, 2025
data-analytics-tool Public
HPLT Analytics

hplt-project/data-analytics-tool’s past year of commit activity

JavaScript 14 GPL-3.0 4 0 1 Updated Sep 29, 2025
release3_inspection Public

hplt-project/release3_inspection’s past year of commit activity

0 3 0 0 Updated Sep 29, 2025
HPLT-WP4 Public
Information and pipelines on WP4: language models training

hplt-project/HPLT-WP4’s past year of commit activity

Jupyter Notebook 3 CC0-1.0 3 4 0 Updated Sep 24, 2025
mtm25-langid Public

hplt-project/mtm25-langid’s past year of commit activity

Python 0 0 0 0 Updated Sep 24, 2025
OpusPocus Public
Marian machine translation training pipeline for thousands of models

hplt-project/OpusPocus’s past year of commit activity

Python 3 0 16 (3 issues need help) 0 Updated Sep 22, 2025
monotextor-slurm Public
Set of scripts to run monotextor-like pipeline under slurm HPCs

hplt-project/monotextor-slurm’s past year of commit activity

Rust 3 GPL-3.0 0 0 0 Updated Sep 18, 2025
HPLT-textpipes Public
Step-by-step schematic description of data processing in HPLT

hplt-project/HPLT-textpipes’s past year of commit activity

Python 0 1 8 1 Updated Sep 11, 2025
hplt-e Public

hplt-project/hplt-e’s past year of commit activity

Jupyter Notebook 2 0 3 0 Updated Aug 24, 2025
HPLT-MT-Models Public
This contains the configuration and scripts for HPLT MT model releases.

hplt-project/HPLT-MT-Models’s past year of commit activity

Python 8 0 2 0 Updated Aug 4, 2025

View all repositories

People

Top languages

Python Jupyter Notebook Shell C++ PHP

Most used topics

Loading…

Uh oh!

There was an error while loading. Please reload this page.

Footer

© 2025 GitHub, Inc.

Footer navigation

Terms
Privacy
Security
Status
Community
Docs
Contact

You can’t perform that action at this time.