Posted by Dylan Wan on March 14, 2009
First, we need to identify where the performance problem come from. The bottleneck can be:
- Source Extract
- Transformation
- Lookup
- Target Write
I will talk about how to isolate the problems and go over each about how to investigate the problem in each of these area.
Read the rest of this entry »
Posted in Business Intelligence, ETL, Infomatica, OBIA | 1 Comment »
Posted by Dylan Wan on July 4, 2008
The OLTP source applications like PeopleSoft and Siebel applications can run on many different databases including Oracle, MS SQL, or DB2. The target data warehouse can also run on different database platforms, incluidng the above databases, plus Teradata.
Various technologies can be used to enable the cross database platform support in the pre-packaged BI apps. Oracle BI Enterprise Edition allows you configure the database connections using the native drivers. ODBC can also be used to access different databases.
In order to deliver to deliver the pre-packaged ETL adapters, two technologies can be used : ANSI SQL and ETL tool specific SQL. It is preferable to avoid the dependency on the ETL plarform and use ANSI SQL92 syntax. When we move from ETL to ELT, Read the rest of this entry »
Posted in BI, BI Application, BI Work, ETL, Infomatica, Oracle, Oracle Data Integrator | Leave a Comment »
Posted by Dylan Wan on June 24, 2008
Typically using SQL*Loader assumes that a flat file will be used as the input. The file will need to be created and generated before the SQL*Loader can take the data from the file and load the data into Oracle. The performance can be improved and the disk space can be saved if you use named pipe with SQL*Loader.
Read the rest of this entry »
Posted in BI, BI Work, Business Intelligence, Data Warehouse, ETL, Infomatica, Oracle, Oracle Data Integrator, Sunopsis | Tagged: ODI, Oracle, SQLLDR | 1 Comment »
Posted by Dylan Wan on June 20, 2008
I found the the language used in Hyperion Essbase documentation is very useful for describing the dimension hierarchy. To communicate effectively, sometime we need precise teams to describe things. The terms defined in the Hyperion Essbase documentation helps.
Read the rest of this entry »
Posted in BI, Business Intelligence, Oracle, PeopleSoft, essbase, hyperion | Tagged: essbase, hyperion, OLAP, Oracle | 1 Comment »
Posted by Dylan Wan on June 9, 2008
ODI is the tool will also be used to develop the ETL (or ELT) for Oracle BI Applications. ODI supports Changed Data Capture by its journalizing module.
My understanding of CDC flow in ODI is as follows: Read the rest of this entry »
Posted in BI, BI Application, BI Work, Oracle, Oracle Data Integrator, Sunopsis | Tagged: ODI | Leave a Comment »
Posted by Dylan Wan on May 30, 2008
Oracle BI Applications 7.9.5 is released early this month. Here is a quick summary of the features introduced in this release and where you can get more information about it.
Read the rest of this entry »
Posted in BI, BI Application, BI Work, Business Intelligence, Data Warehouse, ETL, Infomatica, OBIA, OBIEE, Oracle, Oracle BI Suite EE, PeopleSoft, Siebel Analytics | Tagged: OBIA | Leave a Comment »
Posted by Dylan Wan on May 6, 2008
Account receivables can have a big impact to the cash flow of an organization. Bad credit can hurt your company’s bottom line. Manging customer credits help the company to manage the risk and avoid the issues.
In this post, I will touch credit check and credit limit, centralized and decentralized credit management, and credit limit currency. This is a a result of studying various credit management features in the OLTP system. The objective is to understand how the these various system works and understand how the credit management process looks like, and how BI can help in these processses.
Read the rest of this entry »
Posted in BI, BI Application, BI Work, Business Intelligence, EBS, Financial Intelligence, Oracle, PeopleSoft, SAP | Tagged: Account Receivables Analytics | Leave a Comment »
Posted by Dylan Wan on March 11, 2008
I did some study on the ABC Analysis in Inventory Management. It is also useful in business analytics. I will cover what it is and how it is supported in various ERPs. Finally, how it may be used in analytics application. Read the rest of this entry »
Posted in BI, BI Application, BI Work, Business Intelligence, Data Warehouse, EBS, Oracle, PeopleSoft, Supply Chain Intelligence | Leave a Comment »
Posted by Dylan Wan on March 9, 2008
RFM (recency, frequency, monetary) analysis is used by marketing to determine their campaign targets. It is based on three metrics from the previous sales records: Read the rest of this entry »
Posted in BI, BI Application, BI Work, Business Intelligence, Marketing Intelligence, Sales Intelligence | Leave a Comment »
Posted by Dylan Wan on February 26, 2008
- The number of days is different in each calendar month.
- The week and month cannot be aligned. The number of weekends is different in each calendar month.
- The number of working days is different in each calendar month. It ends up that the number of days in each quarter is also different.
- The period closing day will fall into different days in each period. The accounting department prefers always close the period by a given day in a week, such as Wednesday or Friday.
Posted in BI, Business Intelligence, Data Warehouse | Leave a Comment »
Posted by Dylan Wan on February 26, 2008
I will discuss the following topics:
- What is the 13 period calendar?
- Who uses the 13 period calendar?
- How is it different from the 4-4-5 calendar?
Read the rest of this entry »
Posted in BI, BI Application, BI Work, Business Intelligence, Data Warehouse, Financial Intelligence, Sales Intelligence | 2 Comments »
Posted by Dylan Wan on February 15, 2008
Posted in BI Work, Data Warehouse | 3 Comments »
Posted by Dylan Wan on February 8, 2008
Index is very useful during query, especially in data warehouse. However, it adds the overhead in the storage and ETL process.
I found an excellent article about how to monitor the index usage in Oralce. You should periodically run the index monitoring process and pro-actively drop those un-used indexes. Read the rest of this entry »
Posted in Data Warehouse | Leave a Comment »
Posted by Dylan Wan on February 1, 2008
I will cover how Bitmap index work, when to use it and how to use it in this article.
How does it work?
The bitmap index stores the column values in bits. Each bit represents a single value. For example, the gender column has two possible values: Male and Female. three bit will be used in the bitmap to capture the index on the gender column. A good example can be seen in reference 1. So the more distinct value is, the more space is required to store the bitmap.
Internally, the database engine, like Oracle, uses a map function to converts the bit location to the distinct value. (See reference #2) Many bitmap indexes can be used together since database can merge it, so this can improve the response time. (See Reference #3 for the example of merging the index on Marital Status and Region)
When to use it?
Read the rest of this entry »
Posted in BI, Business Intelligence, Data Warehouse, Oracle, Siebel Analytics | 3 Comments »
Posted by Dylan Wan on January 29, 2008
This is my 4th post about the embedded BI. The key is that a OBIEE and OBIA warehouse based solution is embeddable to the OLTP system as long as the OLTP system can provide the basic support.
In this article, I will discuss one of the key enabling technology – integrated authentication.
Read the rest of this entry »
Posted in BI, BI Application, BI Work, Business Intelligence, EBS, OBIA, OBIEE, Oracle, Oracle BI Suite EE, Siebel Analytics | 2 Comments »
Posted by Dylan Wan on January 28, 2008
I would like to go over some of the embedded BI related technologies you can use to make the data from BI Apps embedded in the OLTP systems.
In this post I will describe the Micro ETL feature from DAC.
Read the rest of this entry »
Posted in BI, BI Application, BI Work, DAC, Data Warehouse, OBIA, OBIEE, Oracle, Oracle BI Suite EE | 1 Comment »