February 11, 2014

Why Data Warehouse Projects Fail ???

Why Data Warehouse Projects Fail ???
The overriding reasons for many decision support projects failure is not that the projects were technically unfeasible. On the contrary, many of the technological challenges of data warehousing have proven answers. The most common cause of failure is that the warehouse did not meet the business objectives of the organization.

Measurement of clear business objectives is critical. Because once the data warehouse project is completed, the management team will have to justify the expenditure. The users always dictate the success or failure of the warehouse. They therefore need to be heavily involved throughout the data warehousing project.

Any substantial project lacking executive management participation has a high probability of failure.

Like any other large information systems project, data warehouse development can get bogged down if the scope is too broad and the number of people involved is too large. A clear purpose and scope are necessary to manage the application of information systems resources, as well as the expectations of potential data warehouse users.

Many large warehouse projects have failed because of an inability of the organization to handle the size and scope of the project. It is tempting to think of a single repository where all of the enterprise's data problems can be solved in one fell swoop.

For the initial data mart, which usually provides the data warehouse proof-of-concept, the scope must be sufficient to provide real, immediate, and high profile benefits.

Blindly copying dirty source data into the data warehouse is extremely dangerous. Dirty data can lead business analysts to make erroneous business decisions and rapidly causes end users to lose confidence in the quality and integrity of the data warehouse. Lack of data integrity in the data warehouse is a common source of failure of many data warehouses and analytical applications.

Disaster recovery is a particular challenge, given the large volumes of data found in today's warehouses. Many organizations just do not take disaster recovery seriously until they had some catastrophic experience.

Unpredictable or unreliable systems management functions will raise user questions over the quality of the information and the usefulness of the data warehouse. In a worst-case scenario, poorly planned and executed system management functions can easily lead users to discontinue using their existing data warehouse applications and halt the funding of new applications.
What is OBIEE ??
OBIEE stands for Oracle Business Intelligence Enterprise edition (Formerly known as siebel analytics). Siebel Analytics is a Data Warehouse that were coming out of the box with pre configured ETL mappings from source (siebel crm) to target (DW)with its reporting component DASHBOARD (Siebel Answers, Disconnect analytics and Administration tool to build dashboard reports => .rpd file)

When Oracle Corp. has acquired Siebel System and decided to make siebel analytics their flagship analytic engine and renamed it OBIEE (obiee server + ETL engine+ Reporting). Now this product is coming with preconfigured ETL mappings and DW schema available for Siebel CRM, Oracle E Business Suite (Financials, HR etc.), JD Edwards, and SAP.

So keep in mind OBIEE is a complete Data Warehouse technology
(server+application+ ETL+report)where Business Object (BO) is reporting component which is one of the best reporting product available in the market. BO can also access and deliver reports that can be build based on OBIEE DW tables
How and where to DownLoad OBIEE
2.Select English, and click on Continue
3.Give the details, Even dummy will do
4.Please check the Check Boxes
5.Click on Continue
6.Select Busines Intelligence
7.Click on GO
9. Click on Oracle Business Intelligence (10.1.3) Media Pack for Microsoft Windows (32-bit)
10. Download Oracle Business Intelligence Suite Enterprise Edition 10.1.3.4.0 for Microsoft Windows1 of 3) B50964-01 Part 1 of 3 217M
12Oracle Business Intelligence Suite Enterprise Edition 10.1.3.4.0 for Microsoft Windows (Part 2 of 3) B50964-01 Part 2 of 3 692M
13.Oracle Business Intelligence Suite Enterprise Edition 10.1.3.4.0 for Microsoft Windows (Part 3 of 3)
Please unzip the downloaded contents into one Folder And follow the Instructions for Installing in Next Blog
for questions Please email training@escalglobal.com, I will be happy to help with installation

February 10, 2014

OBIEE consistency check errors in RPD

1.      Warning [39003] – Missing functional dependency association of a column.
Any Logical Table Source that has been unused in 10g is disabled during the upgrade. Cleaning up such tables before the upgrade might help avoid this warning.
Fix: Enable all the Logical Table Sources that are disabled during the upgrade.
2.      Warning [38028] – column does not have valid data type.
I encountered this error because of the disabled Logical Table Sources (from warning 39003). The datatype for all the columns belonging to the disabled LTS were set to null.
Fix:  Fixing the warning 39003 should fix this error, otherwise check to see if the column has a valid datatype.
3.      Warning [39057] – There are physical tables mapped in Logical Table Sources that are not used in any column mappings or expressions.
Fix: Delete the unused logical tables. Delete the aggregations set for that dimension in the content tab of the fact.
  
4.      Warning [39009] – Logical fact table FACTS have an aggregate source that does not join to a Dimension: source at the proper level of detail.
Fix: Make sure there is a physical join between the fact Logical Table Source and dimension’s Logical Table Source. Make sure the aggregation levels are set at the same grain for both dimension and fact on the content tab.
5.      Warning [39076] – Logical level does not have any key with Use for Display property on.
‘Use for Display’ option is turned off during the upgrade.
Fix: Turn on the ‘Use for Display’ option for all the keys specified.
6.      Warning [39008] – Logical dimension table has a source that does not join to any fact source.
The Logical levels on the content tab for LTS and Fact table are not set properly.
The join between the LTS and Fact table is missing in the physical layer.
Fix the Logical levels on the content tab for Logical Table Sources and Fact table. Both should be set to the same Aggregation level.
Check for any missing foreign key joins between LTS and Fact table in physical layer.

7.      Warning [39062] – Initialization block uses Connection Pool which is used for report queries.  This may impact query performance.
 Update the initialization blocks to use the right connection pool. If a connection pool for the init block does not exist, create a new connection pool so that it does not use the connection pool specified for the queries.

8.      Warning [39028] – The features in database does not match the defaults. This may cause query problems.
 Make sure all the required database features are turned on.

9.      Warning [39074] – Logical dimension table has a source with aggregation content set to level ‘Detail’. The same dimension has aggregation content set in fact source to a higher level.
The aggregation levels are set at different grain for fact dimension tables. Update the content tab for dimension and fact to be at the same level.
 

Default ports for OBIEE 11g
You can find the same file located at below location. bishiphome/Disk1/stage/Response/ 
Oracle WLS BIEE Managed Server SSL Port No = 9804
Oracle Process Manager Local Port No = 6700
Oracle Process Manager Remote Port No = 6701
Oracle Process Manager Request Port No = 6702
 Oracle BI Server Port No = 9703
 Oracle BI Server Monitor Port No = 9701
Oracle BI Presentation Services Port No = 9710
 Oracle BI Scheduler Port No = 9705
 Oracle BI Scheduler Monitor Port No = 9708
Oracle BI Scheduler Script RPC Port No = 9707
Oracle BI Cluster Controller Port No = 9706
Oracle BI Cluster Controller Monitor Port No = 9700
Oracle BI JavaHost Port No = 9810
Essbase Agent Port No = 1423
 

January 18, 2014

Usage Tracking in OBIEE


How to enable usage tracking in OBIEE ?
How to perfrom usage audit in OBIEE ?
How to set you Direct Insertion to Collect Information for Usage Tracking ?
Introduction
Oracle BI server supports collection of usage statistics which can use in a variety of ways such as who is running what and when ? database optimization, aggregation strategies, figuring out most used reports, billing departments as per their usage etc etc.
Goal
We want to achieve a reporting for usage in OBIEE. One such sample report is attached. Lots of analysis similar to this can be achieved using the Usage Tacking.
Usage Tracking Report
Usage Tracking Report
How it works?
When we enable usage tracking, statistics for every query are inserted into a database table or are written to a usage tracking log file. If you use direct insertion, the Oracle BI Server directly inserts the usage tracking data into a relational database table.
There are two ways to achieve Administration of usage tracking.
  • Setting Up Direct Insertion to Collect Information for Usage Tracking
  • Setting Up a Log File to Collect Information for Usage Tracking
Oracle Recommendation: Use direct insertion to write statistics to a database table.And I am going to discuss that method here.
Steps to Set Up Direct Insertion to Collect Information for Usage Tracking:
Set 1 : Create a necessary tables to collect usage tracking information.
Go to \\OracleBI\server\Schema and run the script  SAACCT.Oracle.sql to create table S_NQ_ACCT. This table will hold all the usage tracking information.
B. Go to \\OracleBI\server\Sample\usagetracking
This folder has necessary time series table creation script  and build in repository for usage tracking.
Create a tables using scripts:
Oracle_create_nQ_Clock.sql and Oracle_create_nQ_Calendar.sql
Load data in above tale using  Oracle_nQ_Clock.sql and Oracle_nQ_Calendar.sql script.
Step 2 Import  S_NQ_ACCT into the repository.
Please note: in order for Usage tacking to work properly , one must have to include this table in physical layer.
Step 3  Creating a business and presentation layer.
We will use a repository provided at C:\OracleBI\server\Sample\usagetracking\UsageTracking.rpd So that we want have to create a repositoy from ground zero.
Click  UsageTracking.rpd to down load the usage tracking repository.
Step 4 Change configuration file.
This is most important step in setting up usage tracking.
Go to \\OracleBI\server\Config and open NQSConfig.INI.
We have to make the change in [ USAGE_TRACKING ] portion of the config file.
Change DIRECT_INSERT                  = YES;
Along with this we have change the connection properties as well.
–PHYSICAL_TABLE_NAME
–CONNECTION_POOL
Change below parameter for better insertion performance and insertion control
–BUFFER_SIZE
–BUFFER_TIME_LIMIT_SECONDS
–NUM_INSERT_THREADS
–MAX_INSERTS_PER_TRANSACTION
Please refer below screen shot for more detail.
Note : Any typo will hold server from starting.
NQSConfig DIRECT_INSERT
NQSConfig DIRECT_INSERT
Step 5 Check results to see every things is working.
Copy repository UsageTracking.rpd to OracleBI\server\Repository\
make Star = UsageTracking.rpd, DEFAULT; in NQSconfig file.
Restart BI server. If server fails to start check possible typo in NQSConfig
Check the Answers to see various analysis available for Usage Tracking.
Once should be able to see the reporting as shown below.
Usage Tracking Report
Usage Tracking Report


Translate