actionETL is a cross-platform ETL library for easily writing high performance, highly productive ETL (Extract, Transform, Load) data processing applications in C#, VB etc. running on Windows and Linux.
It has a free Community edition as well as commercial editions.
This benchmark measures the aggregate link throughput when pumping rows across 1 to 1024 actionETL dataflow links, up to 340 million rows/s on an old 4-core PC:
Read the blog post Blazingly Fast ETL Dataflow with .NET and actionETL for full details.
The actionETL library resides on nuget.org, making it easy to install and run this benchmark:
- Get an actionETL free 30-day trial license
- Download this project and put the received license in the "actionetl.license.json" file
- In the project folder, build and run it:
dotnet run --configuration Release
It takes about a minute to run with 4 cores, and will run at 100% CPU utilization during that time. Why not report your results in the blog comments?
NOTE: We create thousands of workers, so logging of
Infomessages has been disabled to focus on the benchmark results. You can change to default logging by changingminlevel="Warn"tominlevel="Info"in "nlog.config" for the file destination like this:<logger name="*" minlevel="Info" writeTo="ToFile" />
This benchmark project is released into the public domain.