otmfaqForumsBlogsRegister
FAQMembers ListCalendarToday's PostsSearch


 Subscribe Blogs:RSS
 Subscribe Forums:RSS
 Follow New Posts:Twitter
OTMFAQ Home
OTMFAQ Blogs
OTMFAQ Forums
OTM Wiki

OTM SIG
OTM Wiki
MavenWire


Data Loading Loading data into OTM / G-Log through CSVs, XML, and the UI.

Reply
 
Submit Tools LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old November 18th, 2008, 15:01
Senior Member
 
Join Date: Aug 2007
Posts: 103
Groans: 0
Groaned at 0 Times in 0 Posts
Thanks: 12
Thanked 1 Time in 1 Post
Rep Power: 3
nikesh mohanlal is on a distinguished road
Duplication of Data load

Hi all,

Version: 5.5

I have a peculiar requirement.
Let's say I create an OR namely: 'XYZ'.
Now, I need to create some 1,00,000 records of same details as of 'XYZ', but with different ORGid.

Can anyone let me know how to do it?
Any specific tool is available which does this job.

Regards,
Nikesh.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2 (permalink)  
Old November 19th, 2008, 14:39
chrisplough's Avatar
Site Moderator
 
Join Date: Jun 2006
Location: West Chester, PA
Posts: 1,156
Blog Entries: 8
Groans: 0
Groaned at 1 Time in 1 Post
Thanks: 137
Thanked 256 Times in 159 Posts
Rep Power: 10
chrisplough is a jewel in the roughchrisplough is a jewel in the roughchrisplough is a jewel in the rough
Send a message via AIM to chrisplough
Re: Duplication of Data load

If you need to create a bunch of Order Releases with the same info, except for the GID - then I'd recommend creating a script and posting these to OTM via an http post. Alternately, if you don't want to deal with XML - you can create these as a CSV file (again, I'd script this - Perl, Python - whatever you prefer) and then upload it to OTM in order to create the data entities.

This is a huge number of records, so the load may take quite some time and you'll want to split up the
data files to make processing easier.

--Chris
__________________
Chris Plough
MavenWire

www.MavenWire.com
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3 (permalink)  
Old November 19th, 2008, 15:36
Senior Member
 
Join Date: Aug 2007
Posts: 103
Groans: 0
Groaned at 0 Times in 0 Posts
Thanks: 12
Thanked 1 Time in 1 Post
Rep Power: 3
nikesh mohanlal is on a distinguished road
Re: Duplication of Data load

Hi Chris,

Many thanks for the instant reply.
Well, I can think of writing a pl/Sql procedure with cursor concept to populate data into the DB,as it is one time job only.

Any idea how long(duration) it will take to load 16,000 OrderRelease records into OTM, with both either as 'xml' or through 'csv' file type option.

Regards,
Nikesh.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #4 (permalink)  
Old November 19th, 2008, 16:36
chrisplough's Avatar
Site Moderator
 
Join Date: Jun 2006
Location: West Chester, PA
Posts: 1,156
Blog Entries: 8
Groans: 0
Groaned at 1 Time in 1 Post
Thanks: 137
Thanked 256 Times in 159 Posts
Rep Power: 10
chrisplough is a jewel in the roughchrisplough is a jewel in the roughchrisplough is a jewel in the rough
Send a message via AIM to chrisplough
Re: Duplication of Data load

The only issue with the SQL population is that you'll have to carefully manage the relevant data in related tables, since you're going behind the application. You'll also need to restart to get a view on the data and any required Agent actions won't be run.

The runtime will depend greatly on your platform and hardware - so it could be anywhere from a few hours to longer.

--Chris
__________________
Chris Plough
MavenWire

www.MavenWire.com
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #5 (permalink)  
Old November 19th, 2008, 17:18
Senior Member
 
Join Date: Aug 2007
Posts: 103
Groans: 0
Groaned at 0 Times in 0 Posts
Thanks: 12
Thanked 1 Time in 1 Post
Rep Power: 3
nikesh mohanlal is on a distinguished road
Re: Duplication of Data load

So with the option of using perl scripts, also, we do need to populate the dependent tables and manage the relevant tables.
Any idea on how to create a perl script to create 'Contacts' records?

Regards,
Nikesh.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #6 (permalink)  
Old November 24th, 2008, 16:41
chrisplough's Avatar
Site Moderator
 
Join Date: Jun 2006
Location: West Chester, PA
Posts: 1,156
Blog Entries: 8
Groans: 0
Groaned at 1 Time in 1 Post
Thanks: 137
Thanked 256 Times in 159 Posts
Rep Power: 10
chrisplough is a jewel in the roughchrisplough is a jewel in the roughchrisplough is a jewel in the rough
Send a message via AIM to chrisplough
Re: Duplication of Data load

No - I'm not advocating direct SQL updates. Regardless of what scripts you use (Perl or otherwise), I recommend loading the data through OTM's XML interfaces - so you'll need to format the XML and then post it via http to the integration servlet. This ensures that you won't have to worry about the information on a table level.

--Chris
__________________
Chris Plough
MavenWire

www.MavenWire.com
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #7 (permalink)  
Old November 25th, 2008, 13:56
Senior Member
 
Join Date: Aug 2007
Posts: 103
Groans: 0
Groaned at 0 Times in 0 Posts
Thanks: 12
Thanked 1 Time in 1 Post
Rep Power: 3
nikesh mohanlal is on a distinguished road
Re: Duplication of Data load

Hi,

Many thanks for the information.

Please explain your understanding in detail.
I am unable to explain.
Any supporting document will help a lot.

Else,

Can I get a generic automated data loading tool which produces any number of records for any business object.
Say for example, I say I would need 4,00,000 records to be created(duplicated) in 'xml' and then uploaded in OTM.

It will be great if anyone let me know, how usually the process of data duplication takes place in OTM.
Any specicfic tool is used?
I tried with JMeter,but did nto worked.

Please share your experience .

Thanking and regards,
Nikesh.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules

Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] 'as.csv' -Load CSV Data via the Application Server geetikadua Data Loading 15 November 4th, 2009 14:28
Interface with load optimizer Hinko Planning 1 December 14th, 2008 01:24
View 3D Load Config sknmail@rediffmail.com Planning 2 July 22nd, 2008 17:33
Extract Data from Czarlite & load into OTM ? MURTHYKO Data Loading 0 May 16th, 2008 04:57
How to Load data into TransOrder Interface kaavya Data Loading 1 April 24th, 2008 04:59



All times are GMT. The time now is 23:00.
Copyright © 2006-2009, Open Book Solutions LLC. All rights reserved.


Inactive Reminders By Icora Web Design

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40