otmfaqForumsBlogsRegister
FAQMembers ListCalendarToday's PostsSearch


 Subscribe Blogs:RSS
 Subscribe Forums:RSS
OTMFAQ Home
OTMFAQ Blogs
OTMFAQ Forums
OTMFAQ Tutorials

OTM SIG
MavenWire


Performance, Scalability and HA Optimizing the performance of OTM / G-Log, configuring Scalability (SCA) and maintaining High Availability.

Tags: ,

Reply
 
Submit Tools LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old April 15th, 2008, 13:34
Junior Member
 
Join Date: Mar 2007
Location: Italy
Posts: 27
Thanks: 4
Thanked 5 Times in 5 Posts
Groans: 0
Groaned at 0 Times in 0 Posts
Rep Power: 0
Stefano is on a distinguished road
Send a message via MSN to Stefano Send a message via Skype™ to Stefano
Question Dedicate Connection POOL to Integration

Hello guys
in your knowledge/experience it's possibile in OTM 5.5CU4 dedicate a connection pool to INTEGRATION ACTIVITY by servlet (xml import and export), dedicate means
  • have a DB sessions connection pool dedicate for integration
  • have a DB sessions connection pool dedicate for UI activity ....and more
  • have a DB sessions connection pool dedicate to process recurring process task
Thanks in advance for your commets or help

Bye
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2 (permalink)  
Old April 15th, 2008, 13:59
chrisplough's Avatar
Site Moderator
 
Join Date: Jun 2006
Location: West Chester, PA
Posts: 782
Blog Entries: 7
Thanks: 49
Thanked 193 Times in 118 Posts
Groans: 0
Groaned at 0 Times in 0 Posts
Rep Power: 10
chrisplough has a spectacular aura aboutchrisplough has a spectacular aura aboutchrisplough has a spectacular aura about
Send a message via AIM to chrisplough
Re: Dedicate Connection POOL to Integration

Stefano,

Honestly, I haven't configured OTM in this way in the past, so I don't know that it's possible. Several of the components exist (being able to create your own DB pool, etc), but I haven't seen them brought together in this way.

I guess my first question is, why? I'm not sure that I see the benefit (performance or otherwise) to breaking out these db connection pools, unless your primary DB connection pool is oversubscribed. In which case, it may be easier to simply increase the capacity, rather than trying to create and maintain various connection pools.

Can you provide more details?

--Chris
__________________
Chris Plough
MavenWire

www.MavenWire.com
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3 (permalink)  
Old April 16th, 2008, 11:24
Junior Member
 
Join Date: Mar 2007
Location: Italy
Posts: 27
Thanks: 4
Thanked 5 Times in 5 Posts
Groans: 0
Groaned at 0 Times in 0 Posts
Rep Power: 0
Stefano is on a distinguished road
Send a message via MSN to Stefano Send a message via Skype™ to Stefano
Arrow Re: Dedicate Connection POOL to Integration

First of all Thank for you answer

I give you more information---
we have migrated to 5.5 last weeked from 5.0 on a teorichally more powerfull architecture, but we are registering a performance problem during import XML from external system, via glog.integration.servlet.WMServlet.
We are investigating on this issue, looking at DB tuning (we had still tuned it with new statistics and so on during our integration test..but seem that some specific query on 5.5 db are worst respect 5.0 db), but in the meantime I want to isolate and separate INTEGRATION activity from USER activity and if possible also from RECURRING PROCESS Activity, because this extra time consumed in integration seems affect also normal UI activity.

Perhaps it's not only a DB problem, could be also a performance problem on App Server ..condiring that we moving out from a BEA old and stable to a new (And not so tested...) OAS

Thanks in advance for any kind of suggestions

Ciao
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #4 (permalink)  
Old April 17th, 2008, 07:47
chrisplough's Avatar
Site Moderator
 
Join Date: Jun 2006
Location: West Chester, PA
Posts: 782
Blog Entries: 7
Thanks: 49
Thanked 193 Times in 118 Posts
Groans: 0
Groaned at 0 Times in 0 Posts
Rep Power: 10
chrisplough has a spectacular aura aboutchrisplough has a spectacular aura aboutchrisplough has a spectacular aura about
Send a message via AIM to chrisplough
Re: Dedicate Connection POOL to Integration

Stefano,

Unfortunately, I don't know how you'd separate off to different db pools, but now I understand why you want to. I guess I'd point to 2 primary issues:
  1. The use of OAS immediately introduces a performance degradation. It may only be 10-20% on most platforms, but can be as high as 200% on Linux, because you have to move away from the JRockit JDK to the Sun JDK.
  2. Many times slowdowns in integration aren't a DB-related issue (though, it's definitely worth checking), but rather caused by either backups in the Event Queues (check via the EventDiagServlet - glog.webserver.event.EventDiagServlet) or with object contention (check via the MediatorDiagServlet - glog.webserver.mediator.MediatorDiagServlet).--
May I ask what is necessitating the swap from WebLogic to OAS?

--Chris
__________________
Chris Plough
MavenWire

www.MavenWire.com
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #5 (permalink)  
Old April 17th, 2008, 08:09
Junior Member
 
Join Date: Mar 2007
Location: Italy
Posts: 27
Thanks: 4
Thanked 5 Times in 5 Posts
Groans: 0
Groaned at 0 Times in 0 Posts
Rep Power: 0
Stefano is on a distinguished road
Send a message via MSN to Stefano Send a message via Skype™ to Stefano
Re: Dedicate Connection POOL to Integration

Chris
We move to BEA to OAS for licences issue......Oracle drive it

We move from BEA WINDOWS servers to LINUX OAS one...

I hope that performance degradation don't reach 200%....someone coud be killed...and ...I'm too young for die

At the moment I perform some fine-fine-fine tuning (interface was in production from 2006 without big problem afeter initial phase) on import procedure related agents that reduce time of importing and situation now is better, however there is any document on the forum or around the world that explains or give suggestions what are most important things to check on "EventDiagServlet"

Thanks

Ciao
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #6 (permalink)  
Old April 17th, 2008, 08:18
chrisplough's Avatar
Site Moderator
 
Join Date: Jun 2006
Location: West Chester, PA
Posts: 782
Blog Entries: 7
Thanks: 49
Thanked 193 Times in 118 Posts
Groans: 0
Groaned at 0 Times in 0 Posts
Rep Power: 10
chrisplough has a spectacular aura aboutchrisplough has a spectacular aura aboutchrisplough has a spectacular aura about
Send a message via AIM to chrisplough
Re: Dedicate Connection POOL to Integration

Haha - I hope you don't die either. Unfortunately, you will see a very significant performance degradation, since you were running on JRockit (it's used with WebLogic on Win32 also) and now you're running with the Sun JDK. If you wanted to verify, I'd recommend installing a temporary WebLogic OTM instance on the Linux server and comparing performance (assuming this isn't PROD).

There isn't a much information on the EventDiagServlet or MediatorDiagServlet (or other OTM utility servlets, for that matter) since they are pretty advanced. Mostly, those of us who have been doing development or performance tuning for years have just built up a knowledge around them. Here is some high-level info, though: http://www.otmfaq.com/forums/f27/doc...vlet-page-639/ (Documentation on using EventDiagServlet page)

I do plan to write up more detailed information about several of them -- I just need to find the time... You know how that work

--Chris
__________________
Chris Plough
MavenWire

www.MavenWire.com
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #7 (permalink)  
Old April 23rd, 2008, 10:07
Junior Member
 
Join Date: Mar 2007
Location: Italy
Posts: 27
Thanks: 4
Thanked 5 Times in 5 Posts
Groans: 0
Groaned at 0 Times in 0 Posts
Rep Power: 0
Stefano is on a distinguished road
Send a message via MSN to Stefano Send a message via Skype™ to Stefano
Question Re: Dedicate Connection POOL to Integration

Thanks Chris
Finnaly using mediator servlet I discover that occassionaly performance problems depends from something blocked, some "object contention"...
We solve this pushing "release" on mediator servlet....but why this happens??
no lock in db session...??
Do you have in your experience any idea??
I did'nt find anything in log, I have to see some special logs item?

BIG Problem seems that during this BLOCKING period OTM become slower...as is JAVA process absorb 100% resource....

(CU4-linux...)

Thanks in advance
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #8 (permalink)  
Old April 24th, 2008, 04:04
chrisplough's Avatar
Site Moderator
 
Join Date: Jun 2006
Location: West Chester, PA
Posts: 782
Blog Entries: 7
Thanks: 49
Thanked 193 Times in 118 Posts
Groans: 0
Groaned at 0 Times in 0 Posts
Rep Power: 10
chrisplough has a spectacular aura aboutchrisplough has a spectacular aura aboutchrisplough has a spectacular aura about
Send a message via AIM to chrisplough
Re: Dedicate Connection POOL to Integration

Stefano,

This contention is a common performance problem for OTM customers and we've been doing a lot of projects around it lately. Usually, these issues are the result of Agent contention and require a detailed look at all of your OTM Agents in order to resolve. You want to ensure that you're not kicking off too many Agents at the same time that work upon the same business objects (orders, shipments, etc). The way the Agents are structured also has a lot to do with the overall performance and contention.

I know this is vague, but getting into OTM Agent optimization is a BIG topic. I hope that this at least points you in the right direction, though.

--Chris
__________________
Chris Plough
MavenWire

www.MavenWire.com
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply



Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Thread Thread Starter Forum Replies Last Post
OTM to BPEL connection error baji OTM / EBS / JDE E1 Integration 14 May 27th, 2008 15:13
Pool Point Linehaul Question otmgal Planning 0 April 1st, 2008 22:37
Pool shipment otmrookie Planning 6 December 13th, 2007 06:11
Dedicated Security pool exhausted sknmail@rediffmail.com Performance, Scalability and HA 3 November 14th, 2007 15:30
Pool Shipment XML AlejandroBarba Integration and Data Mapping 0 August 17th, 2007 16:00



All times are GMT. The time now is 09:47.
Copyright © 2008, Open Book Solutions LLC. All rights reserved.

Sponsored by MavenWire - MavenWire.com


1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37