Professional Documents
Culture Documents
The information in this guide provides practical, set-by-step guides on how to gather data about your open education projectand how to interpret and analyze that data. It will help you answer questions that will inform the planning and development of your open education website; questions such as: What are the top 10 countries that drive traffic to your open education website? How long do your visitors stay? How did they find your website? Is the number of visitors to your site increasing, decreasing or does it remain consistent?
Contents
Why is web analytics important? ............................................................................................... 3 Resources that accompany this guide ....................................................................................... 4 An introduction to analytics ....................................................................................................... 4 Evaluation ............................................................................................................................. 5 Dissemination ....................................................................................................................... 5 Planning & Development ...................................................................................................... 5 Web analytic tools: Google Analytics (GA)................................................................................. 6 Examples of Practice at University College Falmouth .......................................................... 6 How Google Analytics works ...................................................................................................... 7 Limitations ............................................................................................................................ 7 How do you add Google Analytics to your site? ........................................................................ 8 Google Analytics re-cap ............................................................................................................. 8 Who is visiting your site ........................................................................................................ 8 How people explore your site............................................................................................... 9 What GA wont do ................................................................................................................ 9 Choosing meaningful metrics................................................................................................... 10 How to use metrics to manage and understand your website ............................................ 10 UCF openSpace Case Study ................................................................................................ 10 Project-level metrics ........................................................................................................... 11 Institutional-relevant metrics ............................................................................................. 11 Goal Mapping ..................................................................................................................... 12 A short introduction to data analysis ....................................................................................... 13 Our metrics .............................................................................................................................. 14 Website visits ........................................................................................................................... 15 Unique Page Views............................................................................................................... 20 Visitors ..................................................................................... Error! Bookmark not defined. Unique visitors ..................................................................................................................... 22 New Visitors & Returning Visitors ............................................................................................ 24 Bounce Rate ............................................................................................................................. 26 Engagement ............................................................................................................................. 27 Demographic: Top 10 Countries .............................................................................................. 30 Referrers (also known as referring sites) & Traffic sources ..................................................... 32 Keywords.................................................................................................................................. 36 Analytics for Open Education Projects
With a focus on non-commercial educational websites, NGOs, charities, not-for-profit and non-profit organisation focused websites will also find this information applicable for their websites. This guide has initially been developed in conjunction with our free Website Analytics for Open Education Projects online course (http://openspace.falmouth.ac.uk/courses/websiteanalytics-open-education-projects). The course is as a flexible, self-paced non-credit bearing learning experience representing approximately 30 hours of study time. This guide and the accompanying curse, is an introductory level course. It will cover the basic principles and practice of collecting, analysing and interpreting data about the visits to your educational or non-profit website.
There is a nascent movement advocating the practice of using web analytics to improve the quality of online education. Learning analytics refers to the analysis of a wide range of data produced by and gathered on behalf of learners to track how open education learners engage with our resources, predict future engagement and online learning experiences - and spot potential issues. Through analytics, you gain invaluable insights into your open education learners based on how they're accessing the materials and how they're progressing through their learning experience. OER materials need to be constructed and made available online in a way that you can use analytics to understand what's working and what's not on your OE site.
Definitions
Spreadsheet: A spreadsheet is a document file that contains rows and columns. It is typically used to record and compare data. A popular example is Microsofts Excel spreadsheets.
An introduction to analytics
At its most basic, web analytics is the measurement, collection, analysis and reporting of website usage data for the purposes of understanding and optimising users experience of a website. Looking at analytics more broadly, it is a process concerned with more or less answering the following questions, not individually, but holistically: 1. Who is coming to my web site? 2. What are they doing (or better, what are they trying to do)? 3. What is the gap between what they are doing and the intended open education project aims? (and whether we mean
4. 5.
ideal for the organization / institution / business or the customer? This is a very good question!). Think of this as measuring user behavior on your site What are some concrete ways I can close the gaps? How can I get more of my intended audience to visit my site?
Evaluation
As the five questions above illustrate, web analytics is not just a tool for measuring web traffic. It is a process that can be used as a tool: for business and market research, and to assess and improve the effectiveness of a web site to help one in estimating how visitor traffic to a website changes after the launch of a new promotional campaign to provide information about the number of visitors to a website and the number of page views to help gauge traffic and popularity trends which is useful for research and performance monitoring of your website and its content
Dissemination
One of your goals as an open education practitioner is the sharing, re-use and re-purposing of your OERs. Web analytics allows you to see if this goal is being achieved, how its being achieved and what improvements are needed for the user experience. Its a process that will also show how easy it is to discover your website and OERs online as well as how user friendly your website is
Highlights title
text
GA provides the data we need in order to assess these kinds of questions. This is an important distinction to make: Web analytical tools like GA are simply that tools. GA is a tool that provides raw data and we view this data to gain insights. These insights come from analyzing the data produced. The data will show if visitors, for instance, steadily increase, decrease, remains stable or fluctuates wildly from one point in time to the next. It is up to us to assess the reasons behind visitor activity.
3. We might also note a spike or quick upturn in traffic from Australia. In turn, we might investigate ways of forming learning partnerships or a targeted promotional campaign within Australia based on the upsurge of visitors from this country. Understanding web analytics, and developing a practice of analyzing and interpreting the data services like GA, provide can create opportunities for providers of OERs.
Definitions
Limitations
It is worth noting that not every visitor can be tracked, and not all types of interaction can be recorded with the basic installation of GA. And the reasons for these limitations are caused by the internal workings of GA itself. For instance, GA is powered by Javascript code, which can be turned on or off via a users web browser preferences. If a user has the Javascript option turned off, very little information will be collected about their visit to your site or their overall experience. Internet users can also choose to disable cookies, which results in little information being collected about their visit to your site. For more detailed information about how GA works, please visit the Web analytics for Open Education Websites course area on the openSpace website: http://openspace.falmouth.ac.uk/courses/website-analyticsopen-education-projects
It contains the address of the Web site you have visited and codes that your browser sends back to the Web site each time you visit a page there. Cookies from reputable websites don't usually contain personal information or anything dangerous.
Definitions
Analytics for Open Education Projects
SEO: Search engine optimization (SEO) is the process of affecting the visibility of a website or a web page in a search engine results. In general, the more highly your page is (appearing at the top of search engine results), and the more frequently a site appears in the search results list, the more visitors it will receive from the search engine's users.
In order to install the code, you will need administrative access to your website. If you dont have admin permissions for your site, you will need to contact your websites administrator and/or webmaster. If analytics is already installed on your site, you will need to liaise with your websites administrator and/or webmaster to have readonly access to analytic data reports. Alternatively, s/he can send you analytical data reports. You will need to discuss the information you require and the best format to receive the data in. These options will depend upon your institutions guidelines, policies and procedures.
What GA wont do
Analytics for Open Education Projects GA is an effective tool for the many reasons outlined in the introductory parts of this guide. However, as with all tools, it does have its limitations. There is information that GA will not provide, such as: The names of your visitors Email addresses Postal addresses Other personal contact details from your websites visitors
Like many web analytics tools, GA offers a wide range of metrics to report on. This is where understanding what goals you wish to achieve through your open education website or OER project becomes invaluable. Your goals will readily help you identify what would be meaningful data to report on.
10
So how do we determine the metrics we would report on? We identified who was most likely to be interested in our OERS We worked out an online strategy to reach our intended audience Clearly identified our OER project aims and outcomes Recognized and supported institutional goals and strategies
Project-level metrics
At a project-level, based on our defined project goals, we selected the following metrics to report on: Traffic statistics & user experience o General website visits o The number of page views o How many unique visitors visit the site o How many new visitors come to the site o How many return visitors come back to the site o How many visitors only view one page before leaving the site (bounce rate) Demographic statistics o The top 10 countries that account for the overall number of visits and visitors to the site o How long these visitors stay on the site What sites sent our website the most traffic o Traffic sources what are the top sites that send us traffic o Traffic breakdown Direct traffic (saved our url in their browser as a favorite or clicked a link provided in an email, newsletter, etc) Organic traffic (discovered our site via a web browser search) Referral traffic (came from a third party website, blog, etc).
Institutional-relevant metrics
At an institutional-level, we selected the following metrics to report on: Demographic statistics (see above) how does our project fit into UCFs internalization strategy? Deeper engagement with UCF Do visitors to our repository go on to seek further course information on the
11
UCF website? How much traffic does openSpace send to the UCF website? Collaboration, outreach, re-use & re-purposing with other Higher Education Institutions (HEIs) are other HEIs accessing and using our OERS? Raising aspirations /widening participation for higher education (GA wont provide data for this metric. However, from the data, inferences can be made) Are we being social how much traffic is driven to openSpace via social networking services? Understanding our aims and goals has informed our decision about which metrics to choose from a staggering array of metrics available via GA. The metrics weve chosen will be among the more popular metrics for any open education project and website. Analytics for Open Education Projects
Goal Mapping
The metrics outlined in this document are amongst the most accessible and easily understood. Once you have built your web analytics practice, gain confidence in the gathering and reporting of this data, and further explore the various data options available through services like GA, you can expand upon the metrics you choose to report for your own open education website.
12
How to do analysis
Ask : Why? and Why not? to changes in variables and results Ask: How do users actually do X (e.g. navigate around a website) compared to how we think they will do it? Ask: Who are my users and are they all the same? Establish a process for utilizing data to identify any issues, problems and recommend solutions. Establish a process for assessing the strengths and weakness of your site Be sure the metrics you report are tied to project and organizational goals as well as internal and external stakeholders. Focus on actionable data. Avoid data overload.
This process approach will enable you to prioritise initiatives based on impact. For instance, is traffic to your site lower than expected? This probably indicates that your OERs are difficult to find online. Search engine optimsation, online promotion, a press release are options you can choose to enhance the discoverability of your OERs and open education website. Do most of your visitors leave after viewing only the page they landed on in your site? This might indicate a mismatch between visitor expectations and the content that is actually on the page they visited. The information on the page might be confusing or the site itself isnt attractive or user friendly. The same questions can be asked if, overall, the majority of your sites visitors spend a very short time (a minute or less) on your site. Well address analysis as we step through how to collect reporting data.
13
Our metrics
Analytics for Open Education Projects This guide will step you through how to collect the following data and report on the following web analytic metrics: 1. 2. 3. 4. 5. 6. 7. 8. 9. Website visits Page views and Unique page views Visitor statistics (new visitors, returning visitors and unique visitors) Bounce rates Time on site Visitor country of origin Traffic sources Referral traffic Keywords
14
Website visits
Visits represent the number of times your website was visited during a 24 hour period. A Visitor is someone who arrived at your site in a 24 hours period. A visitor may return to your site more than once during a 24 hour period. So while a visitor may be counted once during this period, GA will record all of their visits to your site. Hence the number of visitors and site visits wont be the same. Typically, the number of visits will be larger than the number of visitors this is due to repeat visits from a number of visitors over a 24 hour period.
Once you click on the website youre interested in, you will be taken to the Visitors Overview page (please refer to the image at the top of this page), otherwise referred to as the Dashboard. This gives you a snapshot of your websites statistics for the last 30 days, including the following: Visits: The total number of visits to your site. Visits represent the number of individual sessions that visitors have made to your site. For example, if a visitor leaves your website and returns again later, it is counted as two visits.
15
2. To use a predefined date range, select one of the following from the Date Range menu: a. Today: Data available for the current calendar date up until the time of your selection b. Yesterday: Data for the previous calendar date c. Last Week: Data for Sunday through Saturday of the previous calendar week
d. Last Month: Data for the first to last day of the previous calendar month 3. To set you own dates, select Custom from the Date Range menu, then follow the instructions below. 4. To select a single date a. Click any date on the calendar. b. Enter a single date (in mm/dd/yyyy format) in both Date Range fields. 5. To select a specific week a. Click the first and last days of the week on the calendar. b. Enter the beginning and end dates (in mm/dd/yyyy format) in the Date Range fields.
16
6. To select a range of dates (this will be the most applicable option for your reporting requirements) a. In the calendar, click the desired start date, then click the end date. The selected days are highlighted. You can also enter start and end dates in the Date Range fields, using the mm/dd/yyyy format.
b.
Remember, once you've selected a new date range, click Apply. One you have selected your date range, this date range will be applied to all of the metrics you review during your Google Analytics session.
5. When you enter your data, the graph that accompanies this metric will automatically populate with data:
17
6. If Google Analytics has been activated on your website for more than a few months, you can see how your Visits traffic has changed from one quarter to another. You may decide to gather your current quarters data at the same time and then go on to collect your previous quarters data separately (if available). This approach minimizes the risks of reporting incorrect data between two different quarters. a. Select the date range corresponding to the previous reporting quarter as per the instructions given on Page 16, Selecting Your Reporting Date Range. b. This new date range will provide you with data for previous quarters Analytics for Open Education Projects c. Go to the Website Analytics Data Spreadsheet
d. Go to the Traffic Stats tab, which is displayed at the bottom of the spreadsheet e. Enter the current quarters results in the new quarter cell highlighted in light grey. f. Enter the previous quarters Visitors data in the previous quarter cell also highlighted in light grey.
g. The %Change between the two quarters will automatically be calculated. If there has been a decrease in this metrics, the formulae will illustrate this with a minus sign (e.g. -7.50%) Note: If Google Analytics has recently been set up on your website, it can only provide data from the date it was activated on your website. Google Analytics cannot provide data for the period prior to installation. However, if Google Analytics was installed on your website when it was launched, and this is the first time you have accessed the data, you can gather data from previous monthly quarters by adjusting the reporting timeframe
18
Page Views
Like Visits, this metric is easily located on your Google Analytics Audience Overview page.
When you enter your data, the graph that accompanies this metric will automatically populate with data. As with Page Views, the Website Analytics Data Spreadsheet provides a %Change calculator for this metric, measuring the change in Page Views between the current and previous reporting quarters.
19
4. Go to the Website Analytics Data Spreadsheet 5. Go to the Traffic Stats tab, which is displayed at the bottom of the spreadsheet 6. Enter the number of unique page views in the corresponding reporting Quarter (e.g. Q1, Q2, Q3 or Q4) please see below for an example.
20
When you enter your data, the graph that accompanies this metric will automatically populate with data. As with Page Views, the Website Analytics Data Spreadsheet provides a %Change calculator for this metric, measuring the change in Unique Page Views between the current and previous reporting quarters.
Visits
As a standalone metric, this isnt the most robust or meaningful. It will allow you to measure the ebb and flow of overall visits to your site. It will highlight whether visits to your site have increased, decreased or remained constant over time. This metric gains value when compared with other metrics such as Unique Visitors, New Visitors and Returning Visitors. In other words, it forms a basis for analyzing visitor activity on your site. This metric is easily located on your Google Analytics Overview page. Youve already recorded this data it was the first data set you recorded. Please add the same figure for this section. In case you havent reported this data:
3. Ensure that your reporting time frame hasnt changed, and is the same time period for the data collected for your Visits data.
21
4. Go to the Website Analytics Data Spreadsheet 5. Go to the Traffic Stats tab, which is displayed at the bottom of the spreadsheet 6. Enter the number of visits in the Visitors section for the corresponding reporting Quarter (e.g. Q1, Q2, Q3 or Q4). When you enter your data, the graph that accompanies this metric will automatically populate with data.
What Are Definitions Unique Page Unique Visitors: The unique Visitors? views? visitor
metric page the The unique visitor Uniquecountsviews is number of your total metric counts the a subset of distinct people of distinct numberwho This will page views. visited your to be lower people who have tend website in a particular time visited your website than your total page period, usually one in a particular time views. This metric day. period, usually represents the one day. number of individual visitors who have reviewed your pages. Each visitor to your site is counted only once, no matter how many pages s/he opens.
Analytics for Open Education Projects A %Change calculator hasnt been provided for this metric. However, you can use the %Change calculators for other metrics to measure this change should you wish to.
Unique Visitors
Unique visitors
A unique visitor can contain many visits, each containing many page views. This is still one of the best metrics to use for your website as it tells you the amount of different people that are visiting your website on a daily basis. This is a great indicator of a sites popularity and discoverability online.
22
3. Ensure that your reporting time frame hasnt changed, and is the same time period for the data collected for your Visits data. 4. Go to the Website Analytics Data Spreadsheet 5. Enter your data in the Unique visitors section of the spreadsheet.
A %Change calculator hasnt been provided for this metric. However, you can use the %Change calculators for other metrics to measure this change should you wish to.
23
2.
3.
This will reveal a sub-navigation menu. From the sub-navigation menu, click the New vs Returning link.
This page will provide you with the data you need to enter into the accompanying spreadsheet (see the image below):
24
4. Go to the Website Analytics Data Spreadsheet 5. Go to the Traffic Stats tab, which is displayed at the bottom of the spreadsheet 6. Enter the number of visits in the corresponding part of the Visitors section for the corresponding reporting Quarter (e.g. Q1, Q2, Q3 or Q4).
Enter your data within the Vistors section in the spreadsheet that accompanies this guide. When you enter your data, the graph that accompanies this metric will automatically populate with data. A %Change calculator hasnt been provided for this metric. However, you can use the %Change calculators for other metrics to measure this change should you wish to.
25
Bounce Rate
This is one of the most under-used, but most revealing metrics. To put it simply, it indicates the amount of people that, upon arriving at your website, immediately leave. Therefore, its an important indicator of the quality of a website. A bounce rate below 40% for pages is considered good. This is the overall bounce rate for a website. The free website analytics course on openSpace (http://openspace.falmouth.ac.uk/courses/website-analytics-openeducation-projects) shows how individual website pages also have bounce rates as well as other metrics such as Referral Traffic, Keywords and Country/Territory.
What is a Bounce Rate? Bounce Rate is the percentage of singlepage visits from entrance page visits for individual pages.
2.
3.
Ensure that your reporting time frame hasnt changed, and is the same time period for the data collected for your Visits data.
4. Go to the Website Analytics Data Spreadsheet 7. Go to the Traffic Stats tab, which is displayed at the bottom of the spreadsheet Enter the Bounce Rate number in the corresponding part of the Bounce Rate section for the corresponding reporting Quarter (e.g. Q1, Q2, Q3 or Q4).
5.
26
When you enter your data, the graph that accompanies this metric will automatically populate with data. As with other metrics, the Website Analytics Data Spreadsheet provides a %Change calculator for this metric, measuring the change in Unique Page Views between the current and previous reporting quarters.
Engagement
Engagement is a metric which measures the duration of visits to your site. GA provides other metrics which measure visit duration (for instance, the Average Visit Duration metric which is accessed via the main Audience Overview page). However, the Engagement metric breaks down site visits into distinct time bands, providing a deeper analysis of how long visitors remain on your site. The Engagement metric indicates the amount of time a visitor spends on your website and pages. Its an excellent indicator of the quality of your website, especially open education related websites. The longer the visitors spend on your site, usually, the better. However, if a significant number of visitors are spending a long time on your site, this can be an indicator of a bad website experience people cant find what they are looking for. Its best to combine this metric with the Bounce Rate, Page Views and perhaps the Average Visit Duration to get a more accurate picture of the quality of your website content. For instance, if the majority of your visitors are spending more than 10 minutes on your site, viewing on average more than 5 pages and there is a bounce rate greater than 50%, the combination of these metrics would suggest a difficulty in finding relevant content and hence, a poor visitor experience. We will address examples like this towards the end of this guide. As with Bounce Rate, the engagement metrics is measured at the Pageview, Keyword, Geography metric level. The free website analytics course on openSpace (http://openspace.falmouth.ac.uk/courses/website-analytics-openeducation-projects) covers this in more depth.
Highlights title
text
27
2.
Highlights title
text
3. This will reveal a sub-navigation menu. From the subnavigation menu, click the Engagement link.
This page will provide you with the data you need to enter into the accompanying spreadsheet (see the image below):
28
5. Go to the Demographics tab, which is displayed at the bottom of the spreadsheet Enter the number of visits in the corresponding part of the Visitors section for the corresponding reporting Quarter (e.g. Q1, Q2, Q3 or Q4).
When you enter your data, the graph that accompanies this metric will automatically populate with data. Analytics for Open Education Projects
29
For our purposes, the Country metric provides the level of data were interested in monitoring for our openSpace project.
30
3. This will reveal a sub-navigation menu. From the sub-navigation menu, click the Location link.
This page will provide you with the data you need to enter into the accompanying spreadsheet (see the image below):
.
4. Go to the Website Analytics Data Spreadsheet 5. Go to the Demographics tab, which is displayed at the bottom of the spreadsheet Enter the number of visits from your Top 10 countries in the corresponding part of the Demographics section for the corresponding reporting Quarter (e.g. Q1, Q2, Q3 or Q4).
When you enter your data, the graph that accompanies this metric will automatically populate with data. A %Change calculator hasnt been provided for this metric.
31
Understanding where your traffic comes from will enable you to develop strategies to gain even more traffic from those sites. Or to highlight traffic sources that should be driving traffic to your website and arent. For example, if you notice that youre getting a lot of returning visitors from a well-known blogger, you could develop that relationship into a partnership.
32
33
3. The information for the Traffic Sources cells in the accompanying spreadsheet can be found on this page.
Highlights title
4. Go to the Website Analytics Data Spreadsheet 5. Go to the Demographics tab, which is displayed at the bottom of the spreadsheet 6. Enter the Traffic Sources data in the corresponding part of the Bounce Rate section for the corresponding reporting Quarter (e.g. Q1, Q2, Q3 or Q4).
text
Please note that Traffic source data needs to be entered in percentage format: for instance, 32.59% would be entered as 0.3259. 7. When you enter your data, the graph that accompanies this metric will automatically populate with data. A %Change calculator hasnt been provided for this metric. 8. Return to Google Analytics, remaining on the same page which provided your traffic sources data. 9. Click on the Referrals link from the Traffic sources sub-menu on the left hand column menu.
34
The information for the Referrals cells in the accompanying spreadsheet can be found on this page.
10. 11.
Return to the Website Analytics Data Spreadsheet Go to the Demographics tab, which is displayed at the bottom of the spreadsheet Enter the Referrals data in the corresponding part of the Top Referrals section for the corresponding reporting Quarter (e.g. Q1, Q2, Q3 or Q4). Analytics for Open Education Projects
12.
13.
When you enter your data, the graph that accompanies this metric will automatically populate with data. A %Change calculator hasnt been provided for this metric.
35
Keywords
This is another fundamentally important metric to understand and measure. Its basically a more in-depth version of the top search engines metric. This report will help you write better content using words that your visitors use to find websites related to yours by subject matter and/or content. Using the right mix of popular search keywords enhances the discoverability of your website and its individual pages - so they will rank even higher in search engines. Picking the right keywords is the cornerstone to successfully promoting your website online. Pick the right ones and your website will benefit from the traffic it needs. Pick the wrong ones and your website might be virtually impossible to find on search engine results. Do some research on keywords related to your website, and see how your top keywords compare. If you arent getting many visits from top keywords that other websites related to you are receiving, its time to spend time on Search Engine Optimisation (SEO) to improve the keywords you use on all of you websites pages. Google offers an excellent free guide to SEO, which can be downloaded via: Googles Search Engine Optimization Starter Guide. There are also a myriad of excellent How To SEO videos and tutorials available on YouTube.
2.
36
3.
The information for the Keywords cells in the accompanying spreadsheet can be found on this page:
.
4. 5. Go to the Website Analytics Data Spreadsheet Go to the Demographics tab, which is displayed at the bottom of the spreadsheet Analytics for Open Education Projects
Highlights title
text
37
6.
Enter the Keyword data in the corresponding part of the Bounce Rate section for the corresponding reporting Quarter (e.g. Q1, Q2, Q3 or Q4).
7.
When you enter your data, the graph that accompanies this metric will automatically populate with data. A %Change calculator hasnt been provided for this metric.
Summary
Through monitoring key metrics that measure the performance of websites, you should be able to measure the success of your websites performance. You will gain an understanding of its strengths and weakness; identifying any areas of performance which require improving. Upon reading this guide, you should have: an understanding of Google Analytics, metrics and website analysis - and an understanding of why they are important an understanding of audience: who is your open education website for? How to evaluate and set goals for your website the confidence to investigate other metrics for your website through Google Analytics an understanding of key metric terminology an understanding of why the metrics chosen will benefit your website the ability to interpret and communicate with others about these metrics and the their implications for your website in simple everyday terms an understanding of how to compile a report covering the performance of your open education related website
38