on 10-22-2015 3:10 PM
Hi Gurus,
I'm a newbie to SAP BODS. We have a scenario, where we are joining two flat files to get single column. Both Primary and Reference file records were suppose to be in millions. We don't have any staging DB to push down to sql operations.
In this case, is it better to go for JOIN or LOOK UP? Is there is any other way to improve performance other than staging DB?
Thanks
No, the only viable option is a staging database.
Why do you say you son't have any? Where are your DS repositories created? Use the same database environment, seperate schema or database, depending on the type.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
So, you are preferring JOIN over LOOK UP for large flat files with records in millions? Kindly let me know.
Thanks
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Since you do not have the staging DB , look up option is ruled out. You can join the two flat files ( as file formats).I assume you produce a output file as a result.Look for "Join ranks" in this article Joining tables in the engine - Enterprise Information Management - SCN Wiki
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
That's not true. I don't say it's an option in here, but in general it is (with smaller files). From the SAP Data Services Reference Guide, section 6.3.90 lookup:
"
<lookup_table>
The table or file that contains the result or value you are looking up (<result_column>). The <compare_column> is also located in this table.
"
Dirk , my bad.You are right.
Since you do not have the staging DB , look up option is ruled out. You can join the two flat files ( as file formats).I assume you produce a output file as a result.Look for "Join ranks" in this article Joining tables in the engine - Enterprise Information Management - SCN Wiki
User | Count |
---|---|
84 | |
23 | |
11 | |
9 | |
8 | |
5 | |
5 | |
5 | |
5 | |
4 |
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.