What ETL performance (processing speed) is good enough?

Every ETL developer / Data Warehouse Manager wants to know if the ETL processing speed  (Usually measured in NUMBER OF ROWS PROCESSED PER SECOND on target side)is good enough? What is the industry standard? I can give a politically correct answer like… Well it depends… 

But I would rather be blunt and say that usually for INSERTs, 1000 and for UPDATEs 300 rows/sec should be good enough. If you don’t have special requirements then any average around these numbers should make you comfortable. 

One Response to “What ETL performance (processing speed) is good enough?”

  1. Mike says:

    I think 1000 records per second for inserts is appalling.

    Our software Visual Importer enterprise did 14000 records per second

    http://www.dbsoftlab.com/Latest/NEW-VISUAL-IMPORTER-ETL-UP-TO-7-TIMES-FASTER.html

    Mike

Leave a Reply