Example research work

32
Design Research Small and Mid Sized Enterprises October 2009 – March 2010

Transcript of Example research work

Page 1: Example research work

Design ResearchSmall and Mid Sized EnterprisesOctober 2009 – March 2010

Page 2: Example research work

© Visvapriya Sathiyam. Not to be shared 2

Agenda

Market TrendsUser ResearchDesign RecommendationsPrototype Iteration 1Formative concept ValidationPrototype Iteration 2Summary: Research Approach

© SAP 2008 / Page 2

Page 3: Example research work

Market TrendsPredictive Analytics | Operation BI | Miscellaneous Trends

Page 4: Example research work

© Visvapriya Sathiyam. Not to be shared 4

Predictive Analytics and Data Miningdecision making | risk assessment | statistical analysis | predictive modeling | simulation | unstructured data analysis

Functional Improvements In memory Multiple data marts and databases New business scenarios On-demand

Multiple information models Sentiment Analysis (moods) Social network analytics (customer references) Semantic event processing (business deals) Text Analytics (demographic data) Activity Analysis (buying behaviors)

Real-time Scoring Prediction Quality Scores Graphical accuracy representations Comparative model evaluation Strategy maps and automatic best selection

Model Governance share, compare, comment, send, version, import,

export

Rich interactive interfaces Actionable intelligence / insight to action histograms, heat maps, box plots Portrait 3D visualization

Page 5: Example research work

© Visvapriya Sathiyam. Not to be shared 5

Operational BI enterprise performance management | business activity management | work load analysis

Strategize, Plan, Monitor & Analyse,

take corrective Action Communication, Collaboration, Coordination Scorecards | Six Sigma | methods | practices | metrics Multiple data sources within enterprise Improved Visualization for Dashboards | Interactive |

collaborative | humane Multiple lines of businesses like HR Sales

SAP earned the highest current offering score, and IBM Cognos earned the highest strategy score, with Oracle having the best

combination of both.  Forrester Research, Q4 2009

Page 6: Example research work

© Visvapriya Sathiyam. Not to be shared 6

Miscellaneous Trends SaaS BI | Mobile BI | Open source BI | Microsoft BI | Self-service BI

Saas BI The six key ingredients as defined by GartnerThe six elements are data sources, data models, processing applications, computing power, analytic models, and sharing or storing of results. 

Mobile-BI Alert us. Don’t annoy us. What mobile BI should not doDrilling down into large volumes of data via interactive reports and dashboards on mobile devices doesn’t interest most knowledge workers, he said. They can wait until they’re back in front of their desktop or laptop for that….What knowledge workers do want, according to Gold, is to be notified, via triggers and alerts, of important events that require immediate action.

Open source BI What to learn from them is interaction (Google, Tableau)…free tools from Tableau, Google and others are opening up eyes to the power of interactive visualization tools to unlock the value of large, complex data sets

Microsoft BI King of BI is Excel. Lets accept it. Live with it. And work with it.No matter what we try to do, I don’t think we can get away from Excel,” said Sri Vemparala, manager of reporting and BI at Stanford University in Palo Alto, Calif. Stanford uses applications from several BI platforms, including SAP BusinessObjects, Oracle BI and Oracle Hyperion. But Vemparala said the vast majority of end users – perhaps 90% – take data from the BI tools and export the information to Excel so they can work on it there. Attempting to stamp that out “would be a waste of time

Pervasive BI or Self-service ReportingAnd now there is Power Pivot

Sustainable BIA caution to designers. Design print-friendly, power-limited humane visualizations

Page 7: Example research work

© Visvapriya Sathiyam. Not to be shared 7

Implication for SAP SaaS BI | Mobile BI | Open source BI | Microsoft BI | Self-service BI

Go Everywhere Mashup / Embed into business processes Integrate with CDM tools: SAP StreamWorks Desktop and Office Integration Lean Mobile Integration

Be engaging Enhanced WEB 2.0 Interactivity Advanced visualizations. Graphical and Statistical

models. reduce chart junk. Print friendly. In-memory

Add Instant Value Business users: Predictive Analytics Casual users: self-service reporting

Page 8: Example research work

User ResearchUser Research Background | Competitive Analysis(Excel) | User Scenarios | Design Recommendations

Page 9: Example research work

© Visvapriya Sathiyam. Not to be shared 9

User Research Background

Gomoll Research & Design, USA (SAP Business Objects)

9 customer companies of Business Objects29 individualsApril 2005

Lean Analytics, SAP Labs India

2 customer companies of SAP8 individuals (key users and business users)Aug/Sep 2009

*Despite a huge time-lapse between the two researches and the geographical differences, we found that customers needs have not changed much from then (2005) to now (2009).

Page 10: Example research work

© Visvapriya Sathiyam. Not to be shared 10

Competitive Analysis

MS Power Pivot Features

MS Excel Features

Page 11: Example research work

© Visvapriya Sathiyam. Not to be shared 11

Key User ScenarioReport Creation and Maintenance

Easy report creation

Key users in SMB handle ~200 reports. Creating a new report takes 1 week – 10 days. They want to quickly build reports

One vs. Multiple data source

Users want to combine and analyze data from different sources – excel sheets, data on the web, in their heads. For this reason they use excel workbooks

Manual vs. Automated Review

Draft versions are printed for review. Highlighting / Annotating is done on paper with markers. Shows a strong need for automatic review process of drafts

Page 12: Example research work

© Visvapriya Sathiyam. Not to be shared 12

Business User ScenarioEngaging and Intelligent Analysis

Documenting What-IFs

While doing what-if analysis, user wants to backtrack, annotate and save analysis paths. User is interested in comparing data w.r.t. to his KPIs

Compare across reports

Seeing trends across similar data or looking for similar discrepancies in data across reports is also very common. *Gomoll use cases does not reflect this scenario

Adhoc analysis

A business user would want to drill-into data unavailable in the current report or add additional columns into the report himself.

Change data

Users modify data during what-if analysis or to compare actual vs. data elsewhere

Page 13: Example research work

© Visvapriya Sathiyam. Not to be shared 13

Business User ScenarioSummarizing Reports (management / legal)

Summary vs Details

Alone could have many reports with summarized data (totals, averages). Otherwise there is only one report per view / tab in a summary workbook. Reports are 10-12K line and may contain as much as 10 or more columns

Automatic Formatting

Formatting is done only to meet legal / 3rd party requirements. Automatic formatting should be sufficient for all other purposes

Less charts

Charts are not used at all unless top management wants to see trends and progress graphically

Sustainable Prints

Prints are done from Excel as they consume less ink cartridge (white backgrounds instead of grays and blues)

Page 14: Example research work

© Visvapriya Sathiyam. Not to be shared 14

Key / Business User ScenarioCommunication and Collaboration

Frequent Follow-up

Some users complain that there is frequent follow required to act on the report at any point.

* Users are comfortable to review reports together on a paper print. In India, users are not very comfortable with online collaboration, co-authoring and are not aware of online annotating. Paper post-its, ink marks works best.

Page 15: Example research work

© Visvapriya Sathiyam. Not to be shared 15

Design Recommendations

Tight “data” integration with Excel“without SAP we are dead” “we use SAP 50%, Excel 50%”

Quick Report Creation from scratch (KU) / Ad-hoc Report Modification (BU)Data privacy / security restrictions should be considered

Enhanced notification and collaborationFor co-authoring, reviewing and annotating reportsMore specifically for reducing time lags and frequency of follow-ups

Sustainable solution: Printer friendly reportsWithout background colors, images in B&W, smart identification of landscape vs portrait

Intelligent Analysis based on business needsSpotting trends, getting insights, acting on alerts, viewing related information

Page 16: Example research work

Prototype #1Wireframes | Concept Prototype

Page 17: Example research work

© Visvapriya Sathiyam. Not to be shared 17

Wireframes

Quick Report Creation (KU) / Ad-hoc Report Modification (BU)WYSIWYG: how how the table will look parallel to data exploration.

Save information space or reportSave the consolidated report (tabular) and the data exploration space to recreate at a later point

Graph Visualizationconsider complex relationships – multiple, self referential, one-way,….

Page 18: Example research work

© Visvapriya Sathiyam. Not to be shared 18

Prototype Iteration 1

Page 19: Example research work

© Visvapriya Sathiyam. Not to be shared 19

Prototype Iteration 1

Page 20: Example research work

Formative Usability ValidationKey Takeaways | Example User Feedback

Page 21: Example research work

© Visvapriya Sathiyam. Not to be shared 21

Key Takeaways

Overall impressionAll users currently resort to offline usage of excel (that has to be constructed from scratch weekly/monthly based on latest data). Therefore they find

automatic update of data and quicker modification of report a definite plus.

Top 3 Positive Users like automatic update of data without the need to copy / export data from backend each time

User interface is simple to use and easy to understand

Users find the search capabilities very useful and necessary

Top 3 Negatives Even domain experts do not differentiate between attributes and business objects. The terms seem confusing to them and they are not

sure where they can find their fields (in the attribute list drop down or by further drilling down into next levels of business object nodes)

8/10 users did not understand the difference between data and meta data (class and instance). They expected to be able to filter data in the information space.

All business users used flat tables and VLOOKUP to analyze and connect data. The pivot table was mostly for summarizing. C-level business users use pivot table and flat tables equally.

Page 22: Example research work

© Visvapriya Sathiyam. Not to be shared 22

User Statements

General “Pivot table is also available in ISP. But I don’t use it because my formatting needs are not possible there. I use excel”

“I can also do analysis in ISP, but it is far more convenient in Excel. Moreover I can save my work (including filtering, sorting, formatting) for future reference. The only downside is I have to export the fresh data from ISP everytime I want it”

“system should provide me a default structure on which I can work”

“no one needs the side panel…..(after some thought) but it is neat to see the complete list in the side panel…..i am not sure”

Visual Design “innovative UI, but totally new and looks a bit aerodynamic.” “I prefer a tabular display instead of this flashy UI. It is much more easier to collect the fields that way” “Once I have seen something very simple in SAP”

Search “I want to be able to search in employee.manager.orgunit” for example”

“I will use Ctrl+F to search inside the attribute list” users use pivot table and flat tables equally.

Page 23: Example research work

Prototype #2

Page 24: Example research work

© Visvapriya Sathiyam. Not to be shared 24

Prototype Iteration 2

Page 25: Example research work

© Visvapriya Sathiyam. Not to be shared 25

Prototype Iteration 2

Page 26: Example research work

© Visvapriya Sathiyam. Not to be shared 26

Prototype Iteration 2

Page 27: Example research work

© Visvapriya Sathiyam. Not to be shared 27

Prototype Iteration 2

Page 28: Example research work

SummaryResearch Approach: User Centric Design | Design Thinking | Sustainability

Page 30: Example research work

© Visvapriya Sathiyam. Not to be shared 30

Design Thinking

Page 31: Example research work

© Visvapriya Sathiyam. Not to be shared 31

Sustainability

Sustain-ability

Page 32: Example research work

Thank You!

Contact information:

Visvapriya Sathiyam | [email protected] | +91 988 639 2003