What ETL performance (processing speed) is good enough?

Every ETL developer / Data Warehouse Manager wants to know if the ETL processing speed  (Usually measured in NUMBER OF ROWS PROCESSED PER SECOND on target side)is good enough? What is the industry standard? I can give a politically correct answer like… Well it depends… 

But I would rather be blunt and say that usually for INSERTs, 1000 and for UPDATEs 300 rows/sec should be good enough. If you don’t have special requirements then any average around these numbers should make you comfortable. 


Warning: count(): Parameter must be an array or an object that implements Countable in /homepages/38/d363318921/htdocs/blog/wp-includes/class-wp-comment-query.php on line 405

One Response to “What ETL performance (processing speed) is good enough?”

  1. Mike says:

    I think 1000 records per second for inserts is appalling.

    Our software Visual Importer enterprise did 14000 records per second

    http://www.dbsoftlab.com/Latest/NEW-VISUAL-IMPORTER-ETL-UP-TO-7-TIMES-FASTER.html

    Mike

Leave a Reply