otmfaqForumsBlogsRegister
FAQMembers ListCalendarToday's PostsSearch


 Subscribe Blogs:RSS
 Subscribe Forums:RSS
 Follow New Posts:Twitter
OTMFAQ Home
OTMFAQ Blogs
OTMFAQ Forums
OTM Wiki

OTM SIG
OTM Wiki
MavenWire


Reports / BI / FTI and Other Analytics Integrating OTM / G-Log with Oracle Reports, BI, FTI (OBIEE) and creating custom reports / analytics.

Reply
 
Submit Tools LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old March 7th, 2008, 09:40
Senior Member
 
Join Date: Feb 2008
Posts: 114
Groans: 0
Groaned at 0 Times in 0 Posts
Thanks: 13
Thanked 1 Time in 1 Post
Rep Power: 3
cspadola is on a distinguished road
Issue Running Report in OTM - too much data

Good day...we are experiencing problems with a custom report we created in Oracle Reports to be used in OTM. The purpose of the report is to gather a list of vouchers created within specific dates (usually 2-3 weeks worth) and also to be used to run daily voucher reports - a report showing vouchers created for one specific day.

The report itself works fine and because of the volume of data we deal with, we created a materialized view for this report which improved performance (takes about 10 seconds to retrieve the results). When running the report SQL direct against the DB (using PL/SQL Developer), we get all the results we expect and can export it to a csv file. We then try to do the same using the report in OTM and although we get html results, when we try to export to excel it fails.

Upon investigating this and contacting Metalink, Oracle determined that there was too much data being passed to the report and OTM or Oracle Reports could not handle it. So we cut the date parameter to just one day but even that did not work. A typical report run for 2 weeks of vouchers can return over 35,000 rows of results. Even one day of vouchers can produce 2,500 rows of data of which there is 61 columns in the report.

The issue occurs when we attempt to export to Excel which causes a new window to open but we never get prompted to save it or open it - it eventually times out. Doing this outside of OTM works fine. Oracle says they cannot provide a fix for this as it is our custom report causing this issue.

Can anyone offer any assistance here?

Thanks
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2 (permalink)  
Old March 7th, 2008, 12:07
Senior Member and Blogger
 
Join Date: Nov 2007
Location: Drexel Hill, PA
Posts: 378
Groans: 0
Groaned at 0 Times in 0 Posts
Thanks: 0
Thanked 67 Times in 63 Posts
Rep Power: 3
nick.polites will become famous soon enough
Re: Issue Running Report in OTM - too much data

Have you tried scheduling the report to run so it emails you when it is finished? You can also increase the timeout of the apache server running reports to see if that helps, but I wouldn’t recommend it. Any report that takes over 5 minutes to execute is too long and should be optimized as no doubt there is a bad query within the report. Imagine running a few of these at the same time, you will most likely not only bring down the reports instance but OTM as well.
__________________
MavenWire Hosting Admin
www.mavenwire.com
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3 (permalink)  
Old March 7th, 2008, 12:39
Senior Member
 
Join Date: Feb 2008
Posts: 114
Groans: 0
Groaned at 0 Times in 0 Posts
Thanks: 13
Thanked 1 Time in 1 Post
Rep Power: 3
cspadola is on a distinguished road
Re: Issue Running Report in OTM - too much data

Hi Nick...the problem with scheduling the report is thatit will send a PDF file and not a CSV file which our settlement team needs.

From what Oracle told us, it wasn't necessarily a time-out issue but rather the amount of rows that OTM cannot handle. We optimized this report so that it uses a materialized view and when you run the report in PL/SQL, we get all the results in 10 seconds or less. The same if we run the report in OTM against the mview - we get results in html in about 10 seconds but when we try to export to Excel, that is where the issue starts.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #4 (permalink)  
Old April 30th, 2008, 20:55
Junior Member
 
Join Date: Dec 2006
Posts: 17
Groans: 0
Groaned at 0 Times in 0 Posts
Thanks: 1
Thanked 2 Times in 2 Posts
Rep Power: 0
sprabhakar is on a distinguished road
Send a message via AIM to sprabhakar
Re: Issue Running Report in OTM - too much data

What is the version of OTM that you are using ?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #5 (permalink)  
Old May 1st, 2008, 12:38
Senior Member
 
Join Date: Feb 2008
Posts: 114
Groans: 0
Groaned at 0 Times in 0 Posts
Thanks: 13
Thanked 1 Time in 1 Post
Rep Power: 3
cspadola is on a distinguished road
Re: Issue Running Report in OTM - too much data

We are on OTM v5.5 RU02 CU03
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #6 (permalink)  
Old June 6th, 2008, 15:24
Junior Member
 
Join Date: Dec 2006
Posts: 17
Groans: 0
Groaned at 0 Times in 0 Posts
Thanks: 1
Thanked 2 Times in 2 Posts
Rep Power: 0
sprabhakar is on a distinguished road
Send a message via AIM to sprabhakar
Re: Issue Running Report in OTM - too much data

The way I would go ahead and resolve this would be as given below but this again depends on your environment setup.

1. Create a report that generates the output in XLS format with a specific output report file name.
2. Schedule the report.
3. The scheduled report get stored on the report server in the rptapache/htdocs directory.
4. Have a custom script to pick up the file and send it to the required email address.

We have implemented this for a few customers with success.

Regards,
Prabhakar
__________________
MavenWire

www.MavenWire.com
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #7 (permalink)  
Old June 6th, 2008, 15:34
Senior Member
 
Join Date: Feb 2008
Posts: 114
Groans: 0
Groaned at 0 Times in 0 Posts
Thanks: 13
Thanked 1 Time in 1 Post
Rep Power: 3
cspadola is on a distinguished road
Re: Issue Running Report in OTM - too much data

Hi Prabhakar...I thought that if we put it in the Scheduled Reports section, we can only use PDF export that gets sent by email. We must use an Excel export (xls or csv) so using a scheduled report has not been an option. The group that uses this report needs it in Excel format so that the data can be uploaded easily to a tool they use for invoicing.

The report we created for this does have an export to Excel function but only when it is run manually in OTM via the Reporting Manager page. This is where it fails because of the amount of data involved.

Thanks for your response.

CS
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #8 (permalink)  
Old June 6th, 2008, 16:07
Junior Member
 
Join Date: Dec 2006
Posts: 17
Groans: 0
Groaned at 0 Times in 0 Posts
Thanks: 1
Thanked 2 Times in 2 Posts
Rep Power: 0
sprabhakar is on a distinguished road
Send a message via AIM to sprabhakar
Smile Re: Issue Running Report in OTM - too much data

Hi CS,
Just to make one thing clear - OTM does not restrict you generating a report in CSV/XLS format. When you submit a scheduled report request, OTM hardcodes the DESFORMAT variable to PDF and hence the report output from OTM is always PDF. This can be modified without any issues. you have to follow the below steps to generate a scheduled report in XSL/CSV format

1. In the after parameter form trigger, modify the below line

:P_FILE := TRANSLATE(TRANSLATE(:P_DOMAIN||'_'||:P_REPORT_GID, '.','_'),' ','_')||:P_RPT_JOB||ws_date||'.'||ESFORMAT;

as

:P_FILE := 'XXX.XLS'; ( or any name as you wish)

2. Design the report to produce an XSL/CSV output and schedule the report.

3. Once the scheduled report completes, look for the report XXX.XLS in the rptapache/htdocs folder,

4. Pickup the file and send it out using the custom script.

Please get back to me if you have further questions.

Regards,
Prabhakar
__________________
MavenWire

www.MavenWire.com
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #9 (permalink)  
Old June 9th, 2008, 13:53
Senior Member
 
Join Date: Feb 2008
Posts: 114
Groans: 0
Groaned at 0 Times in 0 Posts
Thanks: 13
Thanked 1 Time in 1 Post
Rep Power: 3
cspadola is on a distinguished road
Re: Issue Running Report in OTM - too much data

Hi Prabhakar, thanks for these instructions.

I must be doing something wrong somewhere. I have changed the :P_FILE section as you suggested and changed this to 'report.xls'; The report was already designed to be exported to Excel as a CSV. I compile with no errors and save it on our server. If I run the report manually, it works fine. But when I run it through the scheduler, it still gets saved as a PDF. When I check the htdocs folder, I see the report I just ran in there but it is PDF. I went in and commented out all the AFTERPFORM pertaining to PDF and XML hyperlink and left the Excel hyperlink as is. Still no luck.

When you say "Design the report to produce an XLS/CSV output", am I not doing that already? Or is there a setting I must make so that it skips the HTML results and goes straight to export to Excel?

Thanks
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules

Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Thread Thread Starter Forum Replies Last Post
What is the recommendation for running a bulk plan? MURTHYKO Planning 0 September 24th, 2008 05:52
error when running public reports rj5316 Reports / BI / FTI and Other Analytics 20 August 4th, 2008 15:08
How to stop a manual report while it is running cspadola Reports / BI / FTI and Other Analytics 4 May 30th, 2008 13:38
[SOLVED] OTM 5.5: CU3 running on Linux AS 3 Upd 4 with JRockit 27.3.1 ianlo Performance, Scalability and HA 1 August 30th, 2007 19:12
Issue in Report Parameters Nisha Reports / BI / FTI and Other Analytics 0 August 10th, 2007 07:59



All times are GMT. The time now is 23:00.
Copyright © 2006-2009, Open Book Solutions LLC. All rights reserved.


Inactive Reminders By Icora Web Design

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40