Sorry! Your operating system is not supported by Carnegie Learning software. Please review the System Requirements page to see what operating systems are supported.

Sorry! Your browser is not supported by Carnegie Learning software and you will need to use a different browser to access the software. Please review the System Requirements page to see what browsers are supported.

MATHia Reports for Administrators

Leadership Report Overview

Leadership Report User Guide

Understanding the Data Definitions

Accessing the Leadership Report

Navigating the Leadership Report

Reviewing the Leadership Report Data

Appendix A: Release Notes and Warning Messages

 

LEADERSHIP REPORT USER GUIDE

Click here to view and download the Leadership Reports user guide.

Leadership Report Overview

We're very excited to announce the release of the MATHia Leadership Report! Leaders can access this report through the Reports button on the MyCL portal. Feedback can also be shared with us directly at productmanagement@carnegielearning.com

MATHia’s Leadership Report provides administrators with a single interactive report to easily:

  • See how many students are actively using the licenses and how much time on average they are using each week.
  • Monitor overall district and individual school performance and progress.
  • Conduct school-to-school comparisons of performance and progress.
  • Assess individual class performance and progress in all buildings.

This report allows for district and building administrators to:

  • Better plan and coordinate with between administrative levels (district and building), math department chairs, and instructional leaders.
  • Determine an intervention plan to further support buildings in a need of additional instruction, instructional time, or technology.
  • Create a platform for discussing overall learning goals and objectives for math instruction.

The leadership report provides two views 1) Schools View, and 2) Classes View. The Multiple Schools View is designed for district administrators and district-level instructional leaders to get insight into all buildings within a district. This view starts with broad look at district performance, then drills down to the building level. The Multiple Classes view looks exactly the same as the Multiple Schools view, but classes are displayed in place of schools.

Understanding the Data Definitions

Data Overview

Four data metrics are featured in the report:

  1. % Active Students (as well as the number of actual active students compared to total enrolled students)
  2. Average minutes per student per week
  3. Average % syllabus completion per student
  4. Average % APLSE Performance per student

Data Analysis Tip!

These four pieces of data are always calculated the same way regardless of applied filters and date ranges.  

Data Accuracy

The data updates periodically throughout the day.

% Active Students

Definition: Percentage of students currently enrolled in a class who've launched into MATHia and navigated to a workspace during the date range selected.

Data Analysis Tips!

  • The report only pulls data on students who are enrolled in the class at the time that the report is generated. Students who were previously removed from the roster are not included.
  • Disabled classes are not included in the Leadership Report

Average Minutes per Student per Week

Definition:  Average minutes per student per week for the date range selected.

Data Analysis Tips!

  • The minutes reflect time in MATHia only, not time spent in the MyCL portal, Resource Center, Tech Support, etc.
  • Time is calculated beginning from when the student launches into MATHia, including Other Time, Unit Overview Time, and Time on Task in the mathematics.

Average % Syllabus Completion per Student

Definition:  Average percent of the syllabus completed by a student at the end of the date range selected.

Data Analysis Tips!

  • Syllabus Completion updates when students complete a workspace, so until a student completes a workspace, their Syllabus Completion will be zero.
  • If assigned, the Getting Started & Pre-Launch Protocol modules are included in this percentage.
  • In addition to the core sequence of modules, the percentage includes also un-sequenced, unlocked modules.
  • Unsequenced, locked modules are not included in the data. 
  • Note that % syllabus completion is cumulative through the school year.  For example, a report that covers only the second quarter will show the percent of the syllabus that the average student has finished by the end of the date range, not the percentage finished during that date range.

Average % APLSE Performance per Student

Definition:  Average APLSE Performance represents how well the average student performed on the workspaces that he/she completed.   

Data Analysis Tips!

  • Each active student’s APLSE Score is divided by the possible APLSE Score for the workspaces the student has completed, and then those percentages are averaged to arrive at the number displayed in the report.
  • The Getting Started & Pre-Launch Protocol modules are NOT included in this percentage.

Accessing Leadership Reports

The Leadership Report is accessible through the Reports button on the MyCL portal (and the Reports option in the grid in Teacher’s Toolkit!) for all users with Supervisor perimissions.

“Supervisor” Users

Users who are identified as Supervisors CAN access the Leadership Report. Supervisor users will continue to have access to Class and Student Reports.

“Instructors” Users

Users who are identified as  Instructors CANNOT access the leadership report.

Wrong Role?

Supervisors can update an Instructor’s role to Supervisor on the Instructor Details page in Teacher’s Toolkit. Click here to learn more about the Supervisor role and to review Step-by-Step instructions on how to update an Instructors role.

Missing a School?

If a Supervisor indicates that they are not seeing a school that they should be seeing, use the Invite Colleagues button on the MyCL portal to invite them as a Supervisor to that school. Click here to review instructions on how to invite a colleague to access another school.

Navigating the Leadership Report

Using the Week Picker

The data is aggregated by week on each of the four Interactive Summary Graphs, so the user is required to select weekly intervals (Sunday to Saturday) on the date picker.

NOTE: If a report is run for a single week, the trend graphs do not appear in the center of the report as the trends are calculated weekly. 

Applying Filters

Filter by School
  • By default, a user will see all of the schools that they are enrolled in as a Supervisor.
  • If a user is enrolled as a Supervisor at Schools A and B and enrolled as an Instructor at School C, they will only see Schools A and B in the Leadership Report, not School C.
  • To see a report for fewer schools, the user can uncheck some of the schools in the list and generate a new report.
Filter by Class Categories
  • When teachers create classes in Teacher’s Toolkit, they have the option to assign a Class Category. These are the same Class Categories that appear in the filter panel of the Leadership Report.
  • The options shown in the selection panel of the Leadership Report for a user include all and only the Class Categories that are assigned to any of the listed schools.
  • Changing Class Categories?  If needed, the teacher can change the Class Category assigned to the class by going into the Class Details in Teacher’s Toolkit.

Filter by Class Profiles
  • When teachers create classes in Teacher’s Toolkit, they have the option to assign a Class Profile. These are the same Class Profiles that appear in the filter panel of the Leadership Report.
  • The options shown in the selection panel of the Leadership Report for a user include all and only the Class Profiles that are assigned to any of the listed schools.
  • Changing Class Profiles?  If needed, the teacher can change the Class Profile assigned to the class by going into the Class Details in Teacher’s Toolkit.

REVIEWING THE DATA 

This section walks through the entire report, from top to bottom. We've also included helpful information about selecting data in the graphs, expanding graphs, and more!

Selection Summary at the Top of the Report

The top of the report features a summary of the number of schools, number of classes, selected Class Categories, and selected Class Profiles that the report includes.

Summary Blocks

The four blocks at the top of the report summarize the data for the selected schools and classes.

These blocks provide you with an opportunity to:

  • See how many students are actually actively using the licenses and how much time on average they are using each week.
  • Monitor overall district and individual school performance and progress.

In three of the categories, we’ve also provided the you with color-coded, recommended benchmarks that visually identify how well the district or school is doing in each of those categories.  The % Syllabus Completion is not evaluated and color-coded as expectations for this metric vary widely across implementations.  For a typical school, the percentage of the syllabus completed should be approximately equal to the percentage of the school year completed.  

Using the Interactive Summary Graphs

The report features a graph for each of the four data metrics summarized in the blocks at the top of the report. Each of the graphs features an “i” icon that displays a description of the graph when selected.

DEFAULT VIEW OF EACH GRAPH

The default view of each of the four interactive graphs displays the averages for the schools included in the report in BLUE.

HIGHLIGHTING A SCHOOL IN A GRAPH

Mousing over a school in the legend highlights the school in PURPLE.

CLICKING/SELECTING A SCHOOL IN A GRAPH

Clicking on school/class name(s) in the legend causes the line to change color and highlights each week’s data value in the graph.

LINK ICON

The Link icon allows users to pick if they want to look at trends for the same schools/classes across all four graphs OR to look at different groups of schools for each of the four metrics.

Schools LINKED Across All Four Graphs

Schools NOT LINKED Across All Four Graphs

Understanding the Data in the Graphs
% ACTIVE STUDENTS GRAPH

  • Use this graph to track student activity against goals.
  • % Active Students includes the percentage of the students who launched into MATHia and navigated to a workspace out of all of the students currently enrolled in a class. The report only pulls data on students who are enrolled in the class at the time that the report was generated. Students previously removed from the roster are not included.
  • Y axis: Always reflects 0 to 100%
  • X axis: Reflects the date range selected, in weeks

AVERAGE USAGE PER STUDENT GRAPH

  • Use this graph to track weekly software usage against goals. Average Usage per Student includes the average minutes spent in the software per student per week for the date range selected.
  • Time is calculated beginning from when the student launches into MATHia, including Other Time, Unit Overview Time, and Time on Task in the mathematics.
  • Y axis (vertical): Reflects 0 to the highest number of average minutes per student per week across the selected schools.
  • X axis (horizontal): Reflects the date range selected in weeks

% AVERAGE SYLLABUS COMPLETION GRAPH

  • Use this graph to track progress towards completion of the content in the syllabus.
  • Y axis (vertical): Always reflects 0 to 100%
  • X axis (horizontal): Reflects the date range selected in weeks

% AVERAGE APLSE PERFORMANCE GRAPH

  • Use this graph to track APLSE performance on the content that the students have completed.
  • Y axis (vertical): Always reflects 0 to 100%
  • X axis (horizontal): Reflects the date range selected in weeks

Additional Navigation of the Graphs

EXPANDED GRAPHS

Selecting the diagonal arrow icon expands the graph for easier reading. The user can then click the 1, 2, 3, and four to rotate through each of the four graphs, displaying one metric per graph. To return to the display of all four graphs together, click on the picture.  

VIEWING INDIVIDUAL SCHOOLS AND CLASSES FROM THE GRAPHS

Selecting the grid icon displays each of the schools (or classes in the class view) included in the report. Scrolling over the graphs will display the data for each of the weeks.

SCHOOLS VIEW

The total number of active students provides insight as to the size of the MATHia implementation at each school.

CLASSES VIEW

Note that the teacher's name displays in this view. 

The Total Number of Workspaces provides insight as to how much work as been assigned to the students.

TABLE VIEW AT THE BOTTOM OF THE REPORT

As you continue to scroll down through the report, you will see a table that contains all of the data displayed above.

Tips for Using the Table!

  • Each of the columns is sortable.
  • Clicking the hamburger menu provides the ability to hide and unhide columns.
  • Syllabus Completion Column:   In addition to the average number of workspaces completed, the report displays the average number of workspaces in a student’s syllabus.  This is provided to give allow more accurate comparison of the data across schools.  For example, completion of 10 percent of a syllabus with 10 workspaces reflects less work, on average, than completion of 10 percent of a syllabus with 50 workspaces.

 

APPENDIX A: RELEASE NOTES AND WARNING MESSAGES

 

Schools that Create New Classes for Each Quarter/Semester

Any schools that create new classes each quarter or semester and disables the previous classes may experience instances in which the report appears to not reflect data for the entire date range selected. We are actively working on this issue with our partners and expect a resolution to be released in a future version of the Leadership Report. Please contact us with any questions at help@carnegielearning.com

Content/Syllabus Changes

Adjustments to content/class sequences may cause instances in which the report appears to not reflect data for the entire date range selected. We are actively working on this issue  and expect a resolution to be released in a future version of the Leadership Report. Please contact us with any questions at help@carnegielearning.com

Export Feature

The ability to export the data featured in the Leadership Report is now available!

Warning Message 1: Alert! Large Amounts of Data 

The message below will display if a user specifies a report that is likely to take more than about approximately 10 seconds to generate. 

As the message says, the user has two options in this case:

  • Cancel: Select Cancel to return to the panel in order to specify a report with fewer schools or more filters.
  • OK:  Select OK to continue generating the report. The report should complete generating in less than a minute, unless there are network interruptions.

 

Warning Message 2: Oops! Too Much Data to Generate Report 

The message below will display if the user specifies a report that is likely to take close to a minute to complete.

In this case, the user must select OK. The alert disappears, and the user can try again after changing the selections.

 

Warning Message 3: Unhandled Request Message

On rare occassions, some users have reported the message below. This tends to occur when the user's network is running slowly. 

Last updated: 08/15/18