What ETL performance (processing speed) is good enough?

Every ETL developer / Data Warehouse Manager wants to know if the ETL processing speed  (Usually measured in NUMBER OF ROWS PROCESSED PER SECOND on target side)is good enough? What is the industry standard? I can give a politically correct answer like… Well it depends… 

But I would rather be blunt and say that usually for INSERTs, 1000 and for UPDATEs 300 rows/sec should be good enough. If you don’t have special requirements then any average around these numbers should make you comfortable. 

This entry was posted on Sunday, May 14th, 2006 at 3:55 pm and is filed under Database Tuning, ETL Performance Tuning, Informatica, Uncategorized. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.

One Response to “What ETL performance (processing speed) is good enough?”

  1. Mike says:
    March 30, 2009 at 8:28 pm

    I think 1000 records per second for inserts is appalling.

    Our software Visual Importer enterprise did 14000 records per second

    http://www.dbsoftlab.com/Latest/NEW-VISUAL-IMPORTER-ETL-UP-TO-7-TIMES-FASTER.html

    Mike

Leave a Reply