What is the biggest shock to the world of learning since the internet? And what is preventing businesses from truly making use of this nascent technology to effect real change? The answer, as explored in a recent episode of the Future of Edtech podcast from Open eLMS, often lies not in the technology itself, but in a fundamental skills deficit and a misguided approach to its implementation.
Host Emil Reisser-Weston welcomed Jon Poulter, Director of AI Transformation at Data and AI Literacy Academy, to delve into these critical questions. Poulter's company specialises in bridging the gap between technical teams and the wider business, empowering employees to engage with data and AI tools for improved decision-making and productivity. His work is vital for organisations aiming to leverage AI effectively, advocating for a "problem-first" approach rather than starting with the tool.
But what exactly does a "problem-first" approach entail? And how does it differ from simply throwing AI tools at every challenge? As Jon Poulter argued, it means deeply understanding the underlying issues from the perspective of those facing them, rather than starting with the AI tool and searching for problems it can solve. This strategic shift, he explained, is crucial for successful AI transformation in corporate training and L&D.
For those keen to delve deeper into this insightful conversation, the full discussion is available on the Future of Edtech podcast. Don't forget to engage with the content and subscribe to the Open eLMS channel for more expert perspectives on the future of EdTech and AI in learning.
Ultimately, the biggest challenge for businesses and L&D managers isn't the capability of AI, but the strategic clarity and cultural readiness of organisations to adopt it effectively to improve employee performance and reduce training costs.
Key Takeaways from the Discussion:
- Task Then Tool: Effective AI transformation begins with identifying specific business problems and only then selecting the most appropriate tool, which may not always be AI. This ensures solutions are truly impactful for corporate training.
- The Power of Qualitative Data: Leveraging AI for sentiment analysis and processing unstructured qualitative data from surveys and interviews provides deeper insights into employee challenges than quantitative data alone, informing more targeted e-learning.
- Bridging the Divide: Establishing a common language and understanding between technical and non-technical teams is paramount for successful AI integration, as AI tools become accessible to a broader user base across the organization.
- Measuring Outcomes, Not Just Completions: The true return on investment (ROI) of learning and AI initiatives should be measured by the business outcomes they drive, such as improved performance and efficiency, rather than just course completion rates – a key focus for any corporate LMS.
- The Right Human in the Right Loop: Human involvement in AI systems is critical, but it must be strategic. Experts should be involved where their specific knowledge and judgment can best identify nuances and potential errors, rather than simply acting as a tick-box gatekeeper.
The "Task Then Tool" Philosophy: A Foundation for AI Success
A core principle guiding Jon Poulter's work is the "task then tool" approach. He explained that organisations should never start with AI and then look for problems it can solve. Instead, the process must begin with a deep understanding of the challenges from those directly experiencing them. This involves a systems thinking approach, analysing what causes a problem upstream and what impact any changes might have downstream. Only once this landscape is understood can the best tool be identified – and that tool is not always AI. Often, established solutions or even human process changes might be more appropriate for effective employee training.
Emil Reisser-Weston observed that many organisations are initiating conversations around AI due to its perceived significance, but often lack the infrastructure to effect real business change, leading to isolated "sandpit" experiments. Poulter agreed, noting that fostering curiosity and engagement is positive, but L&D leaders must also be coached on new challenges, such as data access risks with tools like Co-pilot. Creating a safe environment for experimentation while ensuring robust governance, particularly around sensitive data, is crucial for any corporate LMS implementation.
The Power of Ground-Level Insights: Surveys and Qualitative Data
To truly understand where an organisation is and where it needs to go, Poulter highlighted the power of surveying employees at an individual level, rather than relying solely on leadership assumptions. Asking people about their challenges and how they feel about their environment can reveal critical insights. For instance, an enterprise Business Intelligence (BI) tool might exist, but if employees are unaware of it or feel unable to access it, that indicates a more pressing problem than just data quality. Open eLMS's robust custom reporting and Power BI integration can help surface these insights.
The discussion then moved to the evolving role of qualitative data. Poulter noted that AI, particularly Large Language Models (LLMs), has made previously "too difficult to use" unstructured qualitative data instantly available. This data, gathered through traditional surveys and interviews, allows organisations to identify major challenges faced by individuals, curate learning content that directly addresses those challenges, and build stronger business cases for senior leadership. While quantitative data can inform priorities, qualitative analysis makes solutions human-centric and ensures the right problems are addressed in the right order, enhancing the effectiveness of any e-learning strategy.
Bridging the Technical-Business Divide
The blurring line between technical and strategic staff as AI is leveraged across business processes was another key point of discussion. Poulter explained that a major benefit of data and AI literacy programmes is establishing a common language. When people speak the same way about the same things, many barriers between technology and business functions naturally break down, leading to more cohesive L&D platforms.
He also highlighted a unique aspect of AI: for the first time, a highly technical tool (like generative AI) was initially available to the layman before more technical coding interfaces emerged. This has led to non-technical individuals becoming experts in certain AI applications, fostering a collaborative environment where designers, for example, can prototype ideas almost immediately. This democratisation of capabilities, which Open eLMS champions with its AI-powered course generator, means that the focus shifts from being a "techy" to simply understanding what one wants to achieve in corporate training.
Measuring Real ROI: Beyond Completions
When it comes to demonstrating the impact of AI literacy and certification programmes, Poulter’s academy focuses on measuring outcomes rather than just learning completions. Organisations invest in training to drive business improvements – enhanced performance, identifying opportunities, improving efficiency, and enabling new capabilities. Therefore, the metrics should reflect these strategic priorities, a core goal for any L&D platform.
Emil Reisser-Weston underscored this, pointing out that traditional LMS metrics like completion rates offer little insight into actual ROI. AI, however, provides the ability to crunch vast amounts of data and derive proper ROI. Poulter added that by customising learning content around organisational objectives and then measuring the application of that learning, it becomes easier to demonstrate tangible returns to a CFO. This approach empowers learners to apply their new skills directly to their roles, fostering a sense of achievement and tangible business improvement. Communities of practice, where peers share how they've applied their learning, further reinforce this by breaking down the "that wouldn't work here" mentality. Open eLMS LMS, with its advanced custom reporting and Power BI integration, is designed precisely to help L&D managers track and demonstrate this crucial ROI.
The Human in the AI Loop: A Strategic Imperative
The concept of "human in the loop" systems was a critical point of discussion. Poulter clarified that simply having a human involved is not enough; it must be the right human in the right loop. This means grounding the human's involvement in their area of expertise, allowing them to identify nuances and potential errors that AI might miss. AI is adept at replicating the shape of correctness (e.g., adding a review date), but a human provides the intention behind that action.
He also suggested thinking about "AI in the loop" rather than just "human in the loop," where AI is precisely targeted for tasks it excels at (e.g., consistency, scale). This reduces the need for constant human review. Emil Reisser-Weston noted the misconception that only AI hallucinates, while humans don't make mistakes. He shared Open eLMS's approach of using multiple AIs to fact-check course content, with human designers only intervening if a problem is flagged. This level of analysis wouldn't be possible without AI, showcasing the innovative capabilities of our AI-powered course generator. Poulter reinforced this, highlighting research showing that human experts often judge inconsistently, whereas AI can apply frameworks with far greater consistency, particularly in subjective judgments where right and wrong can be defined.
Fostering a Culture of Confidence and Curiosity
To effectively integrate AI, organisations must foster a culture that embraces change. Poulter advised starting with strategic priorities, then stripping back problems to identify what truly needs to change, using traditional change management and prioritisation techniques.
A key element, he argued, is cultivating curiosity, which is often hindered by a lack of confidence. Empowering the workforce with confidence through training, education, and enablement allows them to apply their curiosity to understand the "why" behind processes and outcomes. This, he suggested, is where organisations will see the most benefit from AI, as individuals become innovative and create new solutions. Emil Reisser-Weston echoed this, recalling the sentiment that one's job won't be taken by AI, but by someone who can use AI – underscoring the vital role of education and platforms like Open eLMS in preparing the workforce for this new era of corporate training.
The discussion concluded by stressing that transforming entire organisations, rather than just changing individual processes, is essential. The landscape has fundamentally shifted, requiring operational excellence and a comprehensive approach to human and AI augmentation.
Ready to Transform Your Learning and Development with AI?
The insights from Jon Poulter highlight a clear path forward for organisations navigating the complexities of AI in learning. By adopting a problem-first approach, leveraging qualitative data, fostering a common language, and strategically integrating AI with human expertise, businesses can unlock unprecedented value and achieve measurable ROI from their L&D initiatives.
Open eLMS is at the forefront of this transformation, offering a one-supplier solution for all your learning and development needs. Our Open eLMS LMS provides a robust, cloud-based platform for comprehensive personnel management, live learning, skills monitoring, and advanced custom reporting with Power BI integration, ensuring you measure real outcomes, not just completions, for your corporate training programmes.
Further accelerate your content creation with the Open eLMS Learning Generator, our AI-powered e-learning solution that allows you to create custom courses, videos, podcasts, and gamification in minutes. Discover how Open eLMS, an established leader in EdTech since 2003, can help you bridge the skills gap, empower your workforce, and drive measurable ROI from your training initiatives with our innovative AI-powered LMS.
Visit https://www.openelms.com to learn more about our AI-powered LMS and learning generation tools.