norm/Gainsight

Fork 0

Files

Norm Rasmussen 34032ab681 Mizuno monthly script. Some cin7 and datasnipper templates and todo list items.

2024-03-04 17:08:39 -05:00

25 KiB

Raw Blame History

Big Ideas Learning

8/25/2022

3 Points for our Meeting:

Analytics
- First back to school season, in October post-mortem report on how year one went
- Wants to discuss data points that would lead to ROI and KPI
- Survey or NPS scores
- Email other important metrics for analysis
These numbers are very low compared to the number of people invited
- The number of groups is the number of total invited groups/clients
- People can opt out,

Flow: 1. Auto email goes out with a description of how to get into the academy 2. No one clicks 3. 110 clients have been invited and each client is a districts 4. Each district could be 2 people or 30 people 5. Are they enabling their districts to forward the emails along?

Custom Reports

Requested Data in Reports:

Group Name + Created + Members
List of People not Necessary
Back to School Season needs it Weekly
Last week of July to Last week of September
Friday Morning Delivery
No Group ID

Overall goal is spending less time in live trainings with small districts (<$50,000) This time last year, 35% of trainings were spent with small accounts This year, 26%! A 10% change.

115 actually did training, ~350 hours This is just training time, hours for travel and planning isn't' factored in This has been successful now and is positioning for something better in the future

Idea has been floated to sell stuff in the future. No timeline or roadmap for this.

Low enrollments because District Contact invites teachers to the platform Larson isn't in control of the communications Might be more comfortable a year from now helping with that It is a sticking point to be in control of teacher's emails and contacts

Other ideas:

SSO for their district
BigIdeasMath.com is where learner's sign in right now
Can we consolidate a single authentication method?
Integrations with: ** Salesforce, Hubspot, Pendo, No BI Tool

Next 6-8 Months:

Back to school "ends" mid-September
Oct-December - Focus on Sales
Jan - Mar - Continued Sales
Launching new product segment, Elementary
- Launched & Begin Sales Fall 2022
- Implemented 2023
- Trained by April 2023
- Development of Resources in February 2022
April is "next year" of Northpass
Integrations, Design, and any other changes should be completed by April of 2023
Wait until November for New Conversations

9/8/2022

They need to train sales people on the new product
And all other employees later in the future, mostly customer-facing employees
Combo of live meetings & LMS
They also need to train their partner, Geographic Learning
Throwing around the idea of using Northpass for this
GL needs accountability - share recording, small quiz, check they are done
Can we use sales training and track actual sales?
Add ammo for Sophia's case
Workflow: attend the live session > Test knowledge >
/app/course, change text to: "Courses | Great Courses from the comfort of your home or classroom."
Add personalized message to /app.

9/22/2022

Takes a course > single question:
- Did you attend live training on {date}?
  - If yes --> Free form course, review material, No quiz (resource)
  - If no --> Milestones, videos, and quiz
There are weekly trainings, that are live
- If they don't attend that, they need to do asynchronous training
- She wants to do scheduled release of sections, but a course per update might make more sense.

10/20/2022

New Product Launch

Big sales training on this product happened
They have recordings and bi-weekly follow up documents of all this new product knowledge
She was hoping to put it into Northpass, but her VP said there is "information overload" and they need to simplify everything.
Initiative fatigue in the company
A big barrier is getting people into Northpass. Setting expectations to have them login to a new system makes it feel like another "task" for employees to do.
So putting it in Sharepoint makes it "a resource" for employees to access on-demand.
One of the challenges that Sophia is facing is the registration process for customers.
Two things she wants to focus on next:
- Short term: Registration process is really messy. Authentication isn't clean for learner

11/17/2022

Weekly Sync

Recreating the partner training, and redoing it again next month. Sophia is hopeful to get to use Northpass for this new product training. Any chance for her teams to utilize Northpass would be beneficial. They have a tool that they can use!

Recreating this training is all delivered via Webinar & Live
Bi-weekly Webinar Updates
Partners decided to opt out of the bi-weekly webinars. Instead, they would much prefer the on-site.

Big shift in the coming weeks. Begin planning a revenue generating professional development product. Two models are being proposed, both are asynchronous. The earliest they will discuss the gap analysis for these initiatives if 29th, with follow up on the 5th. She will let me know on the 22nd if anything changes in their urgency and planning. DONE: Create a deck with all the limitations and advantages of Northpass. Due before Christmas. Interested in the ILTs for the synchronous model.

12/1/2022

Weekly Sync - Internal Enablement for Sophia

Their meeting from Tuesday was moved to tomorrow (12/2). Also, it may not even come up, so this is just good to have on hand. The project tables have turned, but they need to prove that this is valuable. What does that mean? Their EVP's vision of this project (revenue generating professional development product), is different than what he was thinking. Since it's not turning into what he wanted, he's losing interest. He was expecting a different market with a different product. He wanted a broader market and products - but neither serve the company's goals right now. He wanted to go into a market for customers and non-customers. But Larson isn't know as a professional development company, so acquisition would be all but impossible. He didn't realize how far away they were from having that sort of reputation. They are not in a position to create a professional development material for such a large market. Another big goal is retention. But this isn't focusing on that.

Presentation

This will be useful for gap analysis, at some point. She was curious about slide 7 - what was my thought process? She likes it because her and her VP of sales are super focused on retention. But she didn't understand how it might be useful. Her thoughts:

It either needs to be even more detailed with how it all gets done
Or it needs to zoom out and show how the 5 circles fit into the Big Larson logistics

Things to change/add for the presentation: DONE: Better understanding of the ILTs, specifically Live trainings. DONE: They are unsure about automation logistics. What does it look like (the user experience) to Automate (SFDC, Pendo) and Authenticate users, and offer a portal. They now market themselves as Big Ideas Learning, change branding to Big Ideas Learning. Salesforce is what they use for orders, and Pendo is what they use for experience. Retention is based on funding. Many districts can't find budget, they get what they get and that's it. Some do find it from student budgets, intervention funds, etc.

Not many annual contracts. They barely offer 3-year contracts, most are 5-7 years. However, there are always ongoing discussions about changes to contract. For instance, a district might have bought a 6-year contract with only one year of PD. So in year 2 they will look for more PD.

New Projects for 2023:

(Small) Significantly updating their district admin portal. They are thinking about putting together a course for admins to learn more about the changes.
(Small) In the last year, they have increased their integration level with Canvas and Schoology. Districts are expecting them to train on products that aren't theirs. Such as, a course on Schoology or Canvas. Internally, they will create some generic course info for districts.
(Bigger) National and Florida project courses will need to be put together for the new K-5 product. This will be a lift, so they need to get more agile and flexible when it comes to upgrading and creating a new courses. Share best practices on content creation, and workflows and functionality, etc. If they can create and publish courses with fewer videos, that would be best. UX should be effective and enjoyable. The creation of videos can be a big lift. DONE: In next meeting, share how people can more quickly create courses and be more flexible and agile in updating courses.

01/12/2023

Chris Toothman, Tech Lead/Head of Product

They want to expand into professional development. He had some questions:

Can we change the theme, look, and feel to be more inline with branding? - YES!
External/Customer Use Case: Can we do SSO? Or Embed (Big Ideas Math or Ada)? How can we integrate more tightly into their existing app?

SSO Information:

Internal System - it is their clients that use the specific protocols & providers. Embed + Open Auth is what might be easiest. They want to know how to segment and tell Northpass what items and trainings each customer has access to? --> Properties & Groups Big Ideas Math lives on top of a database with all this data. However, they also use Salesforce, which may be a good source of information. The new platform (Ada) is not yet integrated into Salesforce.

Next Steps: Discuss segmentation & group provisioning.

DONE: Send Chris Information regarding embedding, authentication, groups & people, properties, and what design changes are available on enterprise vs premium.

Last Question: Can our authoring tool output into SCORM or other formats (what they call a "learning object").

01/26/2023

Embed Next Steps

Work with Chris in 4-5 weeks (end of February-ish) The team wants a proof of concept to see what an embed looks like.

02/23/2023

How to achieve 90% impact with 10% effort

Her logins to sample:

"https://www.myadamath.com/login" bigideasmath.com UN: smontiel@larsontexts.com PW: BigIdeas!

Redesign.

03/23/2023

Design Update

She gave me her login again to the app. Gave Hubert assets. Sophia is training 8 people across two teams on how to use Northpass and Best Practices. Offered to join her if she needed help.

05/26/2023

Planning for Expansion

The Story:

How can support cs in making every customer a partner
How to continue supporting district goals in years 2-5?

Context:

CS team didn't exist a year ago. Now they have 5.
What can we do to reach districts without manual work or without pushing their goals.
What should be part of the story is the roster of people in Northpass via the platform (embedding).

Tasks:

Norm to do the nitty gritty technical stuff.
Sophia - to bring up and tell the story & Norm to create the tasks that add to that story.

People:

Chris Toothman, Embedding, some technical information
Ruben, CSM - Good at Metrics, CS goals, etc. Ruben managing Planhat.

Concerns:

Restructuring Groups & Analytics concerns her. She is open to archiving everything and "starting fresh" with an academy.
She doesn't know yet where she is going to get this sources for making content.
Where does "follow up" training come from? What are the subjects?
She wants to be trained on making more modular, micro, smaller trainings

06/15/2023

Analytics Feedback

Wants the Learning Path Analysis combined with Course Popularity. Basically, LP Popularity:

How many learners started
How many learners finished
How many were "enrolled" in the learning path.
Unique learner's don't matter TODO: Create above report for Sophia in Looker.

06/29/2023

Project Updates & Bandwidth

First we need to meet with Ruben and Chris to give us context and direction. DONE: Norm to follow up and update Ruben and Chris. Schedule separate meetings, include Sophia.
Sophia will be giving Jason data on a monthly basis. Data points she is delivering:
- Number of districts that have access to Northpass - number of groups even with 0 members.
- Number of activated learners within each group.
- Number by account tier & additional training (SFDC)
- How many learners were active year to date.
- Number of active learners last month.
- Number of learners that have completed each learning path.
- Number of learners that have completed the LP YTD and Last Month.
- YTD = May 1, 2022 - May 1, 2023
- Number of learners that < 100%.

Filters for Multiple

07/24/2023

Sync with Reuben on CS

He's hoping to launch scaled content, micro-learning. What content do they give to customers? CS is new "just off the ground" last year. So what they did last year is:

Engaging with District Level stakeholders, how to bring them into the fold
Wants to see a dual approach for end-user content
Thinking about the cadence of a school year - when are opportune times for engagement?
No matter the size of the district, the cadence of a school year is the same for every customer.
They want to increase engagement across all users - teachers and district people
More importantly, teachers turnover far less than district employees. Having good relationships with teachers is super important.

They had their first "scaled strategy" meeting this last week. They are interested in a viable repository of learning info and want to use Northpass. Hopefully by September 1st.

Quiz Feedback

Quiz feedback

Display information that is wider than correct/incorrect. An example 50% choose C, lets look at why.
Their customers rate them lower when they don't like the quiz questions. Are Big ideas answering the correct items? Sophia's focus has been the data and info for Jason.
Overall goal: "Improve teacher onboarding experieince. Increase product usage and satisfaction."

KPIS

- NPS for high usage districts

Time on tasks for high touch tasks.

08/24/2023

Technical Discussion

Attendees

Sophia
Chris Toothman
Seth Green - Video Content / Moving pictures on a screen
Mary Rose - Art Director for Creative Department/Art Design team
Courtney Nagle - VP of Teacher Learning and Research - New to team
- For this project, spearheading content/course development - pedagogy and content

Goal

To better understand how we can make learners/teachers better and easier access to the academy. To increase usage by delivering faster and easier access. Better access should make these accounts sticker and lead to better retention and less churn. We will also want to discuss design items to make Northpass more like Big Ideas apps.

Discussion

Can Chris' team embed Northpass?
Seth and Mary Rose will be working on designs and deliver us the figma files
They will start using the catalog soon for Reuben and CS engagement
There will be a PD landing page or other landing pages
Sophia said there are a ton of different goals and many use-cases are using Northpass
Sophia needs to be the organizer/ring leader to keep the academy organized.
First time Sophia heard about a timeline/launch in October.
Jason's main goal is to increase Northpass usage.
This creative team of Seth and Mary is pretty new.
- They were in the same office building that was contracted to do design work
- That contractor was then acquired.

09/20/2023

Customer Community Demo

Chris is on Product
Sophia works under Jason who is Go-to-Market.
Seth works with Chris under product.
Courtney works under professional services/education
This Professional Development training from Courtney is "adjacent" but not necessarily directly related to Jason's project.
What do you envision from a content perspective in Community?
- Comms between users
- Comms from course instructors - discussions, Q&A, fireside chats
- Chris clarifications: Leader > All, All > All, Leader > Group, Group > Group, One > One (all/all)
Is this Project/Cohort based Learning?
- Open to being flexible. Instructors might enroll people.
- Single Course learning
- Also, asynchronous learning.
- Districts might also want to enroll entire groups.
- Ongoing education, not just stat and stop.
- They might be subscription based groups.
Do they need embedded?
- Ideally, but a link to go somewhere else is okay for now.

09/22/2023

Catching up Sophia

Meet with Marta re: analytics.
Send Sophia LP analytics before end of next week.
Frustrated with unannounced changes in the platform.

10/06/2023

Access & Design Project

DONE: Get Sophia a marketing number on usage increase between embedded and non-embedded academies.

10/19/2023

Check in - No agenda

Bob has been fired. Is this the sign of a directional change?

Renewal convo:
- Chris Toothman - just promoted to VP!
- Sophia Montiel
- Jason Shilt
- Suen and myself
Procurement time for renewals:
- In the past they took way too long
- Numbers need to be in by December

11/16/2023

Understanding Communities/Education

What is the most segmented vs integrated experience?

Big Ideas App > Click Northpass > How do they then navigate to community from there?

They want to embed a single community/post/section into a single Activity!

Chris and Courtney are at the "prove it" phase. They are interested but unsure how it will work. We need a prototype.

2/22/2024

PD is run by product
2024 push for deeper content, follow up training for app and enablement.
This is geared towards customers >1 year into contract that need more enablement.
Instead of a full training, make it more modular, smaller bites.
"need more help with" assessment, or module design, how can we deliver that training?
Reuben and the CS team - CSMs pushing data to what their clients want to accomplish.
Blanket promote to all courses?
Catalog is not turned on. Let's turn it on!
Send email with follow up items & descriptions.

2/23/2024

Script for adding their Custom end of [quiz verbiage](./Notes for NorthPass Review.docx).

let observer;

let config = {
    attributes: true,
    childList: true,
    subtree: true
};

let eoqMutationObserver = () => {
  observer = new MutationObserver(() => {
      if(document.querySelector('[data-test="quiz-summary"]')){
      // This first if statement is for the survey quiz.
        if(document.querySelector('[data-test="activity-title"]').innerHTML === 'Survey' || document.querySelector('[data-test="activity-title"]').innerHTML == 'Try It'){
          document.querySelector('[data-test="continue-button"]').click();
        }
      // These if statements are all for the Mathematical Learning Experiences (LP01. Course03)
      // Just replace the activity name in the if statement and replace the copy between > < in the action
        if (document.querySelector('[data-test="activity-title"]').innerHTML.trim() === 'Course Pre-Assessment') {
          document.querySelector('[data-test="quiz-summary"]').innerHTML = "<h2 data-test='summary-headline' class='H2-sc-1bdnwwu-0 dZdbwG'>Thank you for taking the time to share your existing knowledge through the course pre-assessment.</h2>";
        }
        if (document.querySelector('[data-test="activity-title"]').innerHTML.trim() === 'Dig In Activity') {
          document.querySelector('[data-test="quiz-summary"]').innerHTML = "<h2 data-test='summary-headline' class='H2-sc-1bdnwwu-0 dZdbwG'>Your responses have been submitted. You may continue with the course.</h2>";
        }
        if (document.querySelector('[data-test="activity-title"]').innerHTML.trim() === 'Investigate Activity') {
          document.querySelector('[data-test="quiz-summary"]').innerHTML = "<h2 data-test='summary-headline' class='H2-sc-1bdnwwu-0 dZdbwG'>Your responses have been submitted. You may continue with the course.</h2>";
        }
        if (document.querySelector('[data-test="activity-title"]').innerHTML.trim() === 'Attend to Precision Activity') {
          document.querySelector('[data-test="quiz-summary"]').innerHTML = "<h2 data-test='summary-headline' class='H2-sc-1bdnwwu-0 dZdbwG'>Thank you for sharing your thinking about how teachers can support students in attending to precision in a mathematics classroom. The next video will provide insight into how each example relates to this practice.</h2>";
        }
        if (document.querySelector('[data-test="activity-title"]').innerHTML.trim() === 'Learning Target Check-In') {
          document.querySelector('[data-test="quiz-summary"]').innerHTML = "<h2 data-test='summary-headline' class='H2-sc-1bdnwwu-0 dZdbwG'>Your self-reflection toward our course learning target and success criteria has been submitted. Thank you!</h2>";
        }
        if (document.querySelector('[data-test="activity-title"]').innerHTML.trim() === 'Construct Viable Arguments and Critique the Reasoning of Others Activity') {
          document.querySelector('[data-test="quiz-summary"]').innerHTML = "<h2 data-test='summary-headline' class='H2-sc-1bdnwwu-0 dZdbwG'>Thank you for sharing your thinking about how teachers can support students in constructing viable arguments and critiquing the reasoning of others. The next video will provide insight into how each example relates to this practice.</h2>";
        }
        if (document.querySelector('[data-test="activity-title"]').innerHTML.trim() === 'Module 4b: Classroom Connections') {
          document.querySelector('[data-test="quiz-summary"]').innerHTML = "<h2 data-test='summary-headline' class='H2-sc-1bdnwwu-0 dZdbwG'>Thank you for sharing your thinking around how each classroom supported mathematical learning experiences through communicating about purpose and content and using questioning and discussion techniques.</h2>";
        }
        if (document.querySelector('[data-test="activity-title"]').innerHTML.trim() === 'Learning Target Check-In') {
          document.querySelector('[data-test="quiz-summary"]').innerHTML = "<h2 data-test='summary-headline' class='H2-sc-1bdnwwu-0 dZdbwG'>Your self-reflection toward our course learning target and success criteria has been submitted. Thank you!</h2>";
        }
        if (document.querySelector('[data-test="activity-title"]').innerHTML.trim() === 'Module 4d: Classroom Connections') {
          document.querySelector('[data-test="quiz-summary"]').innerHTML = "<h2 data-test='summary-headline' class='H2-sc-1bdnwwu-0 dZdbwG'>Thank you for sharing your thinking around how each classroom supported mathematical learning experiences through engaging students in learning experiences and using assessment for learning.</h2>";
        }
        if (document.querySelector('[data-test="activity-title"]').innerHTML.trim() === 'Take & Try Reflection') {
          document.querySelector('[data-test="quiz-summary"]').innerHTML = "<h2 data-test='summary-headline' class='H2-sc-1bdnwwu-0 dZdbwG'>Your Take & Try reflection responses have been submitted.</h2>";
        }
        if (document.querySelector('[data-test="activity-title"]').innerHTML.trim() === 'Course Feedback') {
          document.querySelector('[data-test="quiz-summary"]').innerHTML = "<h2 data-test='summary-headline' class='H2-sc-1bdnwwu-0 dZdbwG'>Thank you for taking the time to provide feedback on your experiences learning in this course.</h2>";
        }
        observer.disconnect();
        observer.observe(document, config);
      }
  });
  observer.observe(document, config);
}

eoqMutationObserver();

03/04/2024

Scoping for Quiz Screens with Courtney

Original request was "100 courses over the next couple years". Is there a way to break it down into quarters or smaller time frames?

Roll out hope: 32 courses across 5 Learning Paths over a period of early 2026. More immediate: 7 courses within 1 year. Hard deadline for these first 7 courses: Q3 of 2025 people are using it. Ready to go and released by end of Q2 2025. Quizzes may be done first - all the content within NP and then videos will be added in later. The seven courses will be released at one time, but they will be authored on a rolling basis. Ideally the updates will be done on that same rolling basis.

Other design changes? Ideal state?

Addressing wrong answers - can we do this for them?
- Currently they are just including another activity after the quiz
- End of quiz is still okay - they just want to hide the correctly responded quiz answers.
Short answer: any hope of having the users responses displayed somewhere.
Where should this show - LX or custom page?
- Both? The activities are involved. If they were in person, they would be discussion based. They want the users to review and reflect on what they just responded on.
- Journal-type page. How can the user look through their previous answers.

25 KiB Raw Blame History