Comparing TADDM performance on different platforms

Introduction

This document compares the running time of running discovery in TADDM 7.1.2 on a virtual environment (VMware ESX) and a non-virtual environment. This is not an comprehensive test, and should not take as TADDM performance result, but just as a comparison study of the TADDM Server in different platforms.

Platforms

Virtual environment

Linux RedHat Enterprise Server Release 5
2 vCPU
3600 MB
VMware ESX, with just 1 VM running

Non-virtual Windows environment

Windows 2003 SP2
2 CPUs
3200 MB
TADDM 7.1.2 and DB2 collocated in one server

Non-virtual Linux environment

Linux RedHat Enterprise Server Release 5
2 CPUs
3200 MB
TADDM 7.1.2 and DB2 collocated in one server

Two server, non-virtual environment

TADDM Server in the Windows environment above
DB2 Server in a separate machine, same specification as the server above

Target environment

37 Computer Systems, consisting of Windows, AIX, HP-UX, Solaris and Linux machines.
Number of components found: 315 (3 Server Equivalents)

Running time

Running time	Virtual environment	Windows environment	Linux environment	Two-server environment
Level 3 Discovery	30 min 47 sec	8 min 49 sec	28 min 37 sec	6 min 4 sec
Level 3 Discovery without WebSphereCellSensor	10 min 36 sec	7 min 43 sec	6 min 16 sec	5 min 8 sec
Level 2 Discovery	10 min 15 sec	5 min 6 sec	7 min 34 sec	4 min 4 sec
100 MB IDML bulk load (250,000 CIs)	13 hours 9 min	5 hours 52 min	13 hours 55 min	22 hours 19 min
Level 3 Rediscovery after bulk load	30 min 4 sec	6 min 47 sec	16 min 25 sec	6 min 24 sec

Conclusions

• Even in a small scale, the discovery process in a Virtual environment is almost 4 times slower than in a non-virtual environment
• Although the run time for other activities don't show significant difference, the discovery process in a Virtual environment is just prohibitive.
• Except for bulk loading, a two-server environment had the best performance in all tests.
  

Bringing Microsoft Active Directory manager information into Tivoli Process Automation Engine

• Go to TPAE, DB Config, select PERSON table and add the following attributes
  
  • supervisor_dn as aln(511);
  
  
  • person_dn as aln(511).

• Still in the DB Config, define the following relationship in the PERSON table:

• Go to TPAE, Cron Task Setup, select LDAPSYNC and create a user mapping like the following:
  

<?xml version="1.0" encoding="UTF-8" ?>
<!DOCTYPE ldapsync SYSTEM "ldapuser.dtd">
<ldapsync>
<user>
<basedn>...</basedn>
<filter>(objectClass=user) </filter>
<scope>subtree</scope>
<attributes>
<attribute>sAMAccountName</attribute>
<attribute>givenName</attribute>
<attribute>displayName</attribute>
<attribute>memberOf</attribute>
<attribute>sn</attribute>
<attribute>manager</attribute>
<attribute>distinguishedName</attribute>
</attributes>
<datamap>
<table name="MAXUSER">
<keycolumn name="USERID" type="UPPER">sAMAccountName</keycolumn>
<column name="LOGINID" type="ALN">sAMAccountName</column>
<column name="PERSONID" type="UPPER">sAMAccountName</column>
<column name="STATUS" type="UPPER">{ACTIVE}</column>
<column name="TYPE" type="UPPER">{PRIMARY}</column>
<column name="QUERYWITHSITE" type="YORN">{1}</column>
<column name="FORCEEXPIRATION" type="YORN">{0}</column>
<column name="FAILEDLOGINS" type="YORN">{0}</column>
<column name="PASSWORD" type="CRYPTO">{0}</column>
<column name="MAXUSERID" type="INTEGER">{:uniqueid}</column>
<column name="SYSUSER" type="YORN">{0}</column>
<column name="INACTIVESITES" type="YORN">{0}</column>
<column name="SCREENREADER" type="YORN">{0}</column>
</table>
<table name="PERSON">
<keycolumn name="PERSONID" type="UPPER">sAMAccountName</keycolumn>
<column name="FIRSTNAME" type="ALN">givenName</column>
<column name="LASTNAME" type="ALN">sn</column>
<column name="STATUS" type="UPPER">{ACTIVE}</column>
<column name="TRANSEMAILELECTION" type="UPPER">{NEVER}</column>
<column name="STATUSDATE" type="ALN">{:sysdate}</column>
<column name="ACCEPTINGWFMAIL" type="YORN">{1}</column>
<column name="LOCTOSERVREQ" type="YORN">{1}</column>
<column name="PERSONUID" type="INTEGER">{:uniqueid}</column>
<column name="HASLD" type="YORN">{0}</column>
<column name="LANGCODE" type="UPPER">{en}</column>
<column name="PERSON_DN" type="UPPER">distinguishedName</column>
<column name="SUPERVISOR_DN" type="UPPER">manager</column>
</table>
</datamap>
</user>
</ldapsync>

• Go to Action application and define the following Action:

• Go to Escalation application and define the following Escalation:

DB2 on Rails

I'm starting again with the IBM_DB adapter gem, available at: http://rubyforge.org/projects/rubyibm/

• gem install ibm_db
• rails newapp
• cd newapp
• ruby script/console
• >> gem 'ibm_db'
  
• ruby script/generate model person
• in the file db/migrate/*_create_person.rb, define the following:

class CreatePeople < ActiveRecord::Migration
def self.up
create_table :people do |t|
t.column :firstname, :string
t.column :lastname, :string
t.column :phone, :stringgg
end
end

def self.down
drop_table :people
end
end

• rake db:migrate
  

DB2 on Rails

It's time to test running Rails with DB2 as the backend.

I downloaded the information from http://www.alphaworks.ibm.com/tech/db2onrails.

I am running on Linux, so I did:

• export DB2DIR=/opt/IBM/db2/V9.1_01
• export DB2LIB=/opt/IBM/db2/V9.1_01/lib32

then:

• cd Source
  
• rake

It failed with the following message:

checking for SQLConnect() in -ldb2... no
*** extconf.rb failed ***
Could not create Makefile due to some reason, probably lack of
necessary libraries and/or headers. Check the mkmf.log file for more
details. You may need configuration options.

Looking at the mkmf.log, I see:

conftest.c:3: error: ‘SQLConnect’ undeclared (first use in this function)
conftest.c:3: error: (Each undeclared identifier is reported only once
conftest.c:3: error: for each function it appears in.)

• It seems the environment variables were not set properly.
• I ran it again and got the following message:

Database environment is not set up
Run ". /home/db2inst1/sqllib/db2profile" and retry


After sourcing the db2profile, I ran with the following messages:

Loaded suite tests
Started
EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE
EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE
Finished in 0.593455 seconds.

But I seems the shared library has been generated successfully.

• cp ibm_db2.so /usr/local/lib/ruby/site_ruby/1.8/i686-linux/

Installing the Adapter

• cp ibm_db2_adapter.rb /usr/local/lib/ruby/gems/1.8/gems/activerecord-2.2.2/lib/active_record/connection_adapters/
• vi /usr/local/lib/ruby/gems/1.8/gems/activerecord-2.2.2/lib/active_record.rb

Well, after trying that without success, I found the following response in the forum:

Given that RAILS_CONNECTION_ADAPTERS went away, the IBM gem is no longer called "ibm_db2", and that the minimum software requirements have changed, I recommend skipping the "Toolkit for DB2 on Rails" and to start learning about the "ibm_db" gem here: http://rubyforge.org/projects/rubyibm/

N.B. The unwarranted license of DB2 Express-C is currently limited to using 2 processor cores & 2 GB of memory. However, it's still a better option than "Oracle XE".

Starting from scratch...

Ruby and DB2

The next step is my Ruby adventure is to use DB2 as the data source. This will allow to plug RoR to many applications that have DB2 as the backend.

* Some instructions on how to download the DB2 driver is described at: http://wiki.rubyonrails.org/rails/pages/IBM+DB2

* After that, let me try to scaffold a DB2-based application: Tivoli Process Automation Engine

* cd ~/Rails
* mkdir TPAE
* cd TPAE
* rails tpae
* cd tpae/config
* vi database.yml

development:
adapter: ibm_db
database: maxdb71
username: maximo
password: itsmswat
schema: maximo
host: ismdbserver.tivlab.raleigh.ibm.com
port: 50005


* rake db:migrate --trace
* It failed with the following message:
Failed to connect to the [maxdb71] due to:
* It seems the problem is related because I forgot to load the DB2 profile
* . ~db2inst1/sqllib/db2profile
* rake db:migrate --trace
* I got a different problem:
Failed to connect to the [maxdb71] due to: [IBM][CLI Driver] CLI0133E Option type out of range. SQLSTATE=HY092 SQLCODE=-99999
* export LIBPATH=/home/db2inst1/sqllib/lib
* It seems I need to read some instructions on http://www.alphaworks.ibm.com/tech/db2onrails. Another day.

Ruby plugin for Eclipse

I found a Ruby plugin for Eclipse at: http://update.aptana.com/update/rails/3.2/

I had first to install Eclipse Monkey, described at http://www.brain-bakery.com/projects/articles/eclipse-monkey-scripting/. Also I had to install the Aptana Studio from: http://www.aptana.com/docs/index.php/Plugging_Aptana_into_an_existing_Eclipse_configuration

There are some instructions on how to use at: http://www.ibm.com/developerworks/opensource/library/os-rubyeclipse/

My first experience with Ruby on Rails

It's a new year, so I decided to learn a new language / environment. I chose Ruby on Rails,so here comes my experience.

I am following the tutorial at: http://www.onlamp.com/pub/a/onlamp/2006/12/14/revisiting-ruby-on-rails-revisited.html, which has been written for Rails 1.2.6. My environment thou is Rails 2.0. So, here are the steps I followed:

• cd ~/Rails
• rails cookbook2
• cd cookbook2
  
• rake db:create:all
  
• ./script/generate scaffold Category name:string
• rake db:migrate
• ./script/server

Then point your browser to http://localhost:30000. It shows the RoR welcome page.

• Go to file config/routes.rb and file the following line:
  

ActionController::Routing::Routes.draw do |map|
map.root :controller=> 'categories'
map.resources :categories

Now point your browser to http://localhost:3000/categories, and you are ready to create categories!

Creating the recipe table

• ./script/generate scaffold Recipe category:references title:string description:string instructions:text
• rake db:migrate

Now point your browser to http://localhost:3000/recipes and you're ready to create recipes!