Nobody is smarter than you when it comes to reaching your students. You know how to convey knowledge in a way that is relevant and relatable to your class. It's the reason you always get the best out of them. And when it comes to planning your curriculum, you know which course materials express the information in the way that’s most consistent with your teaching. That’s why we give you the option to personalise your course material using just the Pearson content you select. Take only the most applicable parts of your favourite materials and combine them in any order you want. You can even integrate your own material if you wish. It's fast, it's easy and fewer course materials help minimise costs for your students.
Data Warehousing in the Real World provides comprehensive guidelines and techniques for the delivery of decision support solutions using open-systems data warehouses.
For more information: catalogue.pearsoned.co.uk/educator/personalisedlearning/index
“Creating a personalised resource was a constructive and positive course development for me, as everything is now integrated, aligned and consistent.” — John Sanders, School of Management and Languages, Heriot-Watt University, UK'
levselector.com |
OLAP & Reporting.
On This Page: | Other Pages: | ||||||||||||||||||||||||||
Operations vs Analysis | home - topof the page - email |
operational processing - OLTP(On-Line-Transaction-Processing) | Research and Analysis - DSS(Decision Support System), OLAP(On-Line-Analytical-Processing), Data mining | |
Optimized for | inserts, updates, and deletes | queries |
Frequency of updates | Frequently (may be every second) | Usually once a day. Data for analysis is prepared once a day (at night)at a staging area, then loaded into the main OLAP database - and then usedduring the day. |
Number of indexes | Few indexes | Many indexes |
Level of normalizing the database | Normalized to some reasonable degree | Heavily de-normalized for easier and faster querying |
Some analysis (for example, Multi-DimensionalAnalysis) is really much better done using specializedsoftware instead of standard RDBMS.
Star schema & Snowflake configurations | home - topof the page - email |
One of the difficulties of querying a normalized database is in the big number of tables you may need to join sequentially in one query. You can easily have to chain 10 and more tables. This is difficult for a user (he must know his tables really well), and it may have very poor performance. Or even crash the database.
The common approach to resolve this problem is to try to restructure the data. You denormalize your tables. You also restructure them into so-called 'star'-configuration to avoid long chains. This means that you create one big 'facts' table (the center of the star) surrounded by 10-15 'dimension' tables. This way you avoid long chains. Then you basically query one central 'fact' table - and narrow your scope by joining it with some 'dimension' tables. Your chain length =1. Sometimes you may add extra 2-nd layer (chain length=2 - details) - this is called the Snowflake configuration - see images: Data Mart & Data Warehouse | home - topof the page - email |
Data mart is usually a set of partiular data designed to meet some specific knowledge needs. It may be one set of tables in Star or Snowflakeconfiguration. But may be something else. A big database with thousands of tables can be represented (for analysis) by tens of Data Marts. Together these Data Marts constitute a 'Data Warehouse'.
Note, that several different star systems can re-use the same dimensiontables.
Multi-Dimensional Analysis | home - topof the page - email |
Example- 4 dimensions: stores, time periods, products, measures.
Thus data relationships can not be fit in a 2-dimentional table. Itis more like a multi-dimensional cube (hyper-cube).
You can slice this cube in different directions - and show a 2-dimensionalslice (or 3-dimensional picture).
Note, that some of cube dimensions correspond to Dimensions of thedata mart (something you would group by - stores, time periods, products),whereas others may be calculated measures (total, average, etc.).
Each dimension usually has some hierarchy- multiple levels of granularity (forexample for time: hour, day, week, month, etc.).
Thus data relationships can not be fit in a 2-dimentional table. Itis more like a multi-dimensional cube (hyper-cube).
You can slice this cube in different directions - and show a 2-dimensionalslice (or 3-dimensional picture).
Note, that some of cube dimensions correspond to Dimensions of thedata mart (something you would group by - stores, time periods, products),whereas others may be calculated measures (total, average, etc.).
Each dimension usually has some hierarchy- multiple levels of granularity (forexample for time: hour, day, week, month, etc.).
The OLAP existed for ~30 years, but the term OLAP (On-Line AnalyticalProcessing) was introduced only in 1993 by Dr. Codd et al. in paper 'ProvidingOLAP to User-Analysts: An IT Mandate'. Yes, the same Codd who formulateddatabase principles in 70s. The work was sponsored by Arbor Software, thecreators of ESSBASE.
OLAP calculations should be fast (under 30 seconds).
![Excel Excel](/uploads/1/2/5/8/125880901/840141151.png)
ROLAP - analysis system based on Relational database.
MOLAP - analysis system using multidimensional database (muchfaster).
HOLAP - Hybrid OLAP.
MOLAP - analysis system using multidimensional database (muchfaster).
HOLAP - Hybrid OLAP.
Formulas
Links.
Links.
When designing your model, adding hierarchies takes less computer resourcesthan adding dimensions.
Search google for olap freethink, praxis olap software, infocube, oracleexpress, etc.
- http://altaplana.com/olap/olap.html- collection of information related to Online Analytical Processing (OLAP)
- http://www-users.cs.york.ac.uk/~kimble/research/ak/info.html-
- www.infogoal.com/dmc/dmcdwh.htm- Directory of Data Warehouse, Data Mining, and Decision Support Resources
- http://bprc.warwick.ac.uk/bp-tool.html- hardware/software vendors
- www.praxisint.com/solution/businessintelligence/index.asp- Praxis International (FreeThink)
- www.credata.com/research/dwsites.html- Hot Sites on Data Warehousing
- http://www.dmreview.com/master.cfm?NavID=152&AuthorID=1573- OLAP Market Review
- www.dmreview.com/ - DM ReviewMagazine
- http://altaplana.com/olap/olap.html- collection of information related to Online Analytical Processing (OLAP)
- http://www-users.cs.york.ac.uk/~kimble/research/ak/info.html-
- www.infogoal.com/dmc/dmcdwh.htm- Directory of Data Warehouse, Data Mining, and Decision Support Resources
- http://bprc.warwick.ac.uk/bp-tool.html- hardware/software vendors
- www.praxisint.com/solution/businessintelligence/index.asp- Praxis International (FreeThink)
- www.credata.com/research/dwsites.html- Hot Sites on Data Warehousing
- http://www.dmreview.com/master.cfm?NavID=152&AuthorID=1573- OLAP Market Review
- www.dmreview.com/ - DM ReviewMagazine
Search Google for OLAP:
- http://directory.google.com/Top/Computers/Software/Databases/OLAP/?tc=1-
- http://directory.google.com/Top/Computers/Software/Databases/Data_Warehousing/-
- http://directory.google.com/Top/Computers/Software/Databases/Data_Mining/-
- http://directory.google.com/Top/Computers/Software/Databases/OLAP/?tc=1-
- http://directory.google.com/Top/Computers/Software/Databases/Data_Warehousing/-
- http://directory.google.com/Top/Computers/Software/Databases/Data_Mining/-
software | home - topof the page - email |
- www.knowledgestorm.com/- and search for OLAP - you will get ~200s of software solutions.Here are some (not properly sorted, and I am sure that some important onesare missed - please let me know at - [email protected]) :
BusinessObjects - powerful reportingsystem, a BI (Business Intelligence) platform and integrated BI toolset. Have designer application, deliver via browser. Has effective and optimizedsubscribtion/distribution mechanism. Allows to do multidimensional analysis,slicing/dicing, drill down/up. - www.cognos.com/products/powerplay/- CognosPowerPlay - by Cognos, Inc. - the world's best-sellingOLAP software lets users explore volumes of data with sub-second response. Can use browser or Excel as a client. Has data store and application serverto serve thosands of users simultaneously. - MicrosoftAnalysis Services for MS SQL Server. Took big share of the market.MDXlanguage (Multidimensional Expression (MDX) - like SQL, but works withmultidimensional cubes). ProClarity (www.proclarity.com/)offers third party OLAP CLient (Knosys). - www.hyperion.com/ -Hyperion'sEssbaseOLAP server and Analysis Tools - used by millions of users. - DB2 OLAP server- IBM's Essbase clone, IBMRedBrick® Warehouse - a high-performance database server (fromInformix) - http://www.teradata.com - Teradata (spin-off from NCR in 2007) - database engine optimized for Datawarehousing (for reading, not for inserting). Used for huge data warehouses (Fortune 100 companies, for example, major arilines). NCR = National Cash Register. - www.oracle.com/olap/ - OracleExpress - Multidimensional Server (MOLAP), the 4GL SPL (Server ProgrammingLanguage), Oracle Express Objects toolkit (to handle multi-dimensionaldata), many utilities for administraiont, monitoring, loading the data,OWB (Oracle Warehouse Builder - ROLAP), Oracle Express Analyzer, OracleDiscoverer, Express Web Publisher, Spreadsheet Add-ins, Oracle Darwin (dataminingsoftware that finds meaningful patterns hidden within corporate data),Oracle Financials, etc. - www.crystaldecisions.com- by Crystal Decisions (Former Seagate Software) - web-basedinfrastructure for analysis and reporting accross the enterprise(Crystal Reports, Crystal Enterprise, Crystal Applications, Crystal Analysis,Holos Analytic System, Seagate Info, BI Technology Spectrum). Simpledistribution of pdf reports. - www.applix.com/solutions/- Applix ITM1 - www.MicroStrategy.com -MicroStrategy- OLAP, etc. - www.brio.com/products/overview.html- Brio Intelligence, Brio Portal, Brio Reports - buildbusiness intelligence, enterprise reporting, analytics. Slow performance.Powerful query analyser tool which works over the web (via plugin). Good Javascript model which allows the building of 'EIS screens' to givepushbutton / search box / sort etc. without the user having to understandhow to use pivottables and drill-down graphs. - www.sap.com/solutions/bi/- mySAP Business Intelligence, Business Warehouse, etc. - by SAPAmerica, Inc. - www.actuate.com - Actuate - TheActuate e.Reporting Suite 5. Report server for report generation - producesROI (proprietary format), PDF and spreadsheet. Reports have richcontent and can be hyper-linked. Actuate runs on both Unix and NT servers.Example of usage: generate 30,000 reports each night. |
* www.livewarepub.com/- R&R Report Writer - Liveware Publishing, Inc. (X-base and SQL versions(formerly known as Arpeggio))
* www.srs-inc.com/Products/ReportSmith/RSFeatures.asp- ReportSmith - (Strategic Reporting Systems, Inc.)
Informatica- good product for data preparation in the staging area. - www.whitelight.com/ - WhiteLightanalytic platform - www.siebel.com - Siebel eMarketing- by Siebel Systems, Inc. - Siebel eMarketing enables organizationsto create, execute, and assess Web-based marketing campaigns. - - ADAPT (Application Design for Analytical ProcessingTechnologies) by Symmetry Corporation - design methodology specificallyto represent the objects and operations found in OLAP applications. - - OutlookSoft Enterprise Analytic Portal - by OutlookSoft - - WebFOCUS Business Intelligence Dashboard & Developersstudiio - by Information Builders, Inc. - reporting - www.PeopleSoft.com - PeopleSoftTree and Cube Manager - by PeopleSoft - users can define thedata they want to extract into an OLAP cube. - - KPMG's Interpreter - transfer pricing software - byKPMG LLP - - Cardinal Supervisor and Cardinal Explorer - by Symtrax -automatically captures, formats and distributes output from Mainframe,ERP, database and other systems. - - Outfront CRM[tm] by Primal Solutions, Inc. - helps you identifywho your high-value customers are and why, and how to ... - - PolyAnalyst - by Megaputer Intelligence Inc. - a completehigh-end data mining tool. - - Datapan manufacturerAgent - by Askfor Business Solutions- real-time pdf customized reports - - DI-Atlantis - by Dimensional Insight, Inc.- multidimensionalsoftware package for intuitive access and analysis. - - eEnterprise Business Analytics Series - by Microsoft GreatPlains Business Solutions - - DocuAnalyzer - by Mobius Management Systems, Inc. - - Infinium Business Intelligence Analytic Server (BIAS) - byInfinium Software, Inc. - a multi-dimensional business analysis - - Horizon OLAP Reporting and Analysis - by Walker InteractiveSystems, Inc. - OLAP Reporting and Analysis is the first reporting applicationbuilt specifically for financial reporting, analysis and modeling froma multi-dimensional database. - - DataTracker - by Silvon Software, Inc. - OLAP - - MARS - by Salford Systems - an automated regressionsoftware tool which is highly competitive to Neural Nets in the solutionbut the insights are more clear. See also CART (decision tree toolto search for patterns) - - Adaytum e.Planning - by Adaytum Software Inc - an enterprisebusiness planning solution - - IDENTITY SYSTEMS (IDS) - by Search Software America - Persons,Organizations and Addresses can be searched, matched and retrieved despitethe error, variation or format of the data. - - BizWorks - by interBiz - an eBusiness Process ManagementSuite - - WizWhy - by WizSoft, Inc. - a data mining tool for revealingtrends, rules, errors, and interesting phenomena in the data - - Hummingbird BI/Suite - by Hummingbird Ltd. - a fullyintegrated, scalable business intelligence solution (OLAP) - - CorManage - by CorVu Corporation - Balanced Scorecard applications,OLAP Query and Reporting, executive dashboard alerts, forecasting and what-ifanalysis. - - AnalyzerSuite - by ChiCor Information Management, Inc. - OLAP-based AnalyzerSuite - create graphical representations ofmulti-dimensional data. - - Comshare Decision - by Comshare, Inc. - Enables rapiddevelopment of custom business intelligence applications such as balancedscorecard, customer and market analysis and BI portals. - - NetWORKS ONEview - by Manugistics, Inc. - a set of applicationsbased on industry-standard OLAP technology - - iM:Analyzer - by iMedeon, Inc. - a Results Performance Manager(RPM) with a knowledge repository - - Monarch/ES Report Portal: Business Intelligence & WebEnterprise Reporting - by Datawatch Corporation - - - Nuggets - by Data Mining Technologies, Inc. - DataMining Software Toolkit - Rule Induction Engine, Prediction, Segmentation,Validation. Uses state of the art proprietary rule induction without statistics. - - WebFOCUS OLAP - by Information Builders, Inc. - automaticallyOLAP-enables any report, so users can slice-and-dice information and detectpatterns in any cellspacing='0' cellpadding='0' width='100%' bgcolor='#C4ECFF'> | |
books | home - topof the page - email |