Question:
10 million records are there in Oracle Database.
Parallel process is the best solution, but my question is...
DB connect is the best way OR convert into Flat file and do the extraction process.
Which is the best way.
Advance thanks
Thanks
Manju
Answer:
Somebody correct me if I am spreading mis-information but I believe you could dump the 10M Oracle records into 10 files each with 1M records and load all 10 files in parallel to the ODS.
I haven't worked with DB Connect so I can't speak to the pros/cons of that approach and contrast against loading the flat files.
If you do go the flatfile approach and load multiple files in parallel you'll want to understand/monitor the activation process.
I don't know if it is best to have automatic ODS activation loading so many files in parallel. I seem to recall there was an OSS Note that said there was issues with that.
If you just loaded to the ODS without automatic ODS activation you will want to schedule the activation in the background.
I don't know that there is a perfect solution - there are trade off you have to balance.
Answer:
Hi,
I'm working right now with DBConnect to Oracle, and it work fine.
For me, DBConnect is the best option because it is a high performance tool to extract from external databases. In my case, itīs faster than extracting from R/3.
I will recomend to you to use Function Modules with native SQL, to do Generic extractors, instead of using the autogenerated data source provided by the DBConnect wizard tool.
I have load a millon records and the load fails because of a problem with too many records when it comes to master data. But it seems to work well with transactional data.
Hope this helps,
ABW