Technology Tales

A curated selection of five free online courses provides a structured pathway for individuals aiming to progress from being a beginner in large language models to a practitioner capable of deploying and managing them in real-world applications.

• The first course, by Andrej Karpathy, focuses on building foundational knowledge of neural networks and language models from scratch, covering topics such as automatic differentiation and transformer architectures.
• The second, from FSDL, addresses the practical aspects of implementing language models in production environments, covering prompt engineering, deployment and evaluation.
• The third, a Stanford course, delves into the theoretical and large-scale training aspects of language models, including data collection, transformer implementation and training optimisation.
• The fourth, offered by Hugging Face, provides hands-on experience with fine-tuning techniques, including low-rank adaptation and reinforcement learning from human feedback.
• The final course, from DeepLearning.AI, covers deployment strategies, agent orchestration and integration with external systems.

Together, these courses form a comprehensive learning journey that progresses from theoretical understanding to practical application, enabling learners to develop the skills needed to work with large language models effectively.

Several providers now offer free access to large language models for learning, prototyping and experimentation in 2026:

• GroqCloud focuses on rapid inference with model specific daily limits.
• OpenRouter provides access to more than 25 rotating models with limits of 20 requests per minute and 50 per day.
• Cloudflare Workers AI offers 10,000 Neurons daily for serverless applications and supports capabilities including vision and function calling.
• Mistral provides 10 dollars of monthly credit across its models, API and coding assistant, subject to account limits.
• Google Gemini API offers free use of selected models, including Gemini 3.7 Flash, alongside multimodal understanding, embeddings and agent development.

These services make it possible to explore AI applications without immediate usage charges, although allowances and model availability may change.

The European Commission has designated ChatGPT, Reddit and Roblox under the Digital Services Act, classifying the first as a Very Large Online Search Engine and the rest as Very Large Online Platforms due to their reach of at least 45 million average monthly users in the EU. These services must comply with additional obligations by January 2027, including assessing and mitigating systemic risks related to illegal content, user well-being and public security.

The Commission will oversee compliance, collaborating with national authorities in Ireland and the Netherlands and will investigate the functionalities of these services. The changes focus on ChatGPT's operations as an AI-driven search engine, while Reddit and Roblox function as platforms enabling user-generated content and interactions, qualifying them under the DSA's definitions. These designations bring heightened scrutiny to services with significant societal impact, with the Commission now overseeing 28 such entities under the Act.

Claude's text watermarking method, introduced to comply with the EU AI Act, involves subtly altering the randomness in word selection during text generation to create an undetectable pattern for verification purposes. This approach does not affect the quality, content, or readability of outputs, as the changes are imperceptible to readers and do not introduce additional tokens or costs.

The watermarking technique, based on a method developed by Google DeepMind, uses a cryptographic key to influence low-stakes word choices, allowing verification of AI involvement without compromising the model's performance. It cannot confirm human authorship, distinguish between different AI systems, or trace content back to specific users or organisations. The method is less effective on factual or highly structured content, such as code, where exactness is required and may have limited impact on short texts or heavily edited material.

Additional measures, such as a future watermark detection API and cryptographic credentials for files, are being developed to support transparency. The implementation applies globally, with ongoing efforts to refine regional scope and address limitations in detection accuracy.

Most teams building with agentic AI are walking toward predictable failures driven not by flawed technology but by five correctable misconceptions. The first is treating autonomy as a binary goal rather than a structured property, when in reality agents should move freely through reversible steps but require explicit human approval before executing irreversible actions such as deletions, purchases or external sends. The second is mistaking a polished demo for a production-ready deployment, since compound reliability mathematics show that even a 95% per-step accuracy rate across a ten-step workflow yields only a 60% end-to-end success rate. The third is the assumption that equipping an agent with more tools makes it smarter, when it actually enlarges the failure surface, particularly through functional hallucination where an agent selects the wrong tool or fabricates a result without triggering any obvious error signal. The fourth misconception concerns accountability, illustrated by a 2024 Canadian tribunal ruling that found Air Canada legally responsible for misleading information provided by its AI chatbot, establishing that an agent's outputs are the deploying organisation's outputs regardless of how the AI reached its conclusion. The fifth and perhaps most counterintuitive error is believing that upgrading to a more capable model resolves reliability issues, when research indicates that failures in multi-agent systems are primarily architectural in nature, compounded by poor data quality and the absence of per-step observability that would surface silent errors before they propagate through a workflow.

Setting up Claude Code to work with local models involves a few straightforward steps that make the process accessible even to those with limited technical expertise. The core idea is to redirect the application’s requests from Anthropic’s API to a locally hosted inference server, which can be powered by tools like Ollama, LM Studio, or llama.cpp. Once the server is running and a suitable model is downloaded, configuring three environment variables (ANTHROPIC_DEFAULT_SONNET_MODEL, ANTHROPIC_BASE_URL and ANTHROPIC_AUTH_TOKEN) suffices to complete the setup.

This shift eliminates reliance on external services, offering benefits such as reduced costs, enhanced data privacy and the ability to use models tailored to specific needs. The choice of model depends heavily on available hardware. For instance, glm-4.7-flash requires minimal resources and is ideal for users with limited RAM, while larger models like qwen3.5:27b demand significant VRAM and processing power. Ensuring compatibility between the model name specified in the environment variables and the one recognised by the server is critical to avoid errors. Additionally, troubleshooting common issues—such as connection failures or tool call errors—often involves verifying server status, updating software versions, or adjusting configuration settings.

The practical outcome of this setup is a functional coding assistant that operates entirely on the user’s machine, bypassing the limitations of cloud-based services. This approach not only provides greater control over the development environment but also reflects the growing trend of leveraging local AI infrastructure for tasks that were previously dependent on external APIs. The process, though technical, is designed to be approachable, allowing users to focus on their work without the overhead of complex configurations.

The European Parliament voted in June 2026 to approve a regulation amending the EU AI Act, with 423 members in favour, marking a significant step toward formal adoption ahead of an August 2026 deadline. The amendments, which emerged from trilogue negotiations between the Parliament, Council and Commission, cover ten key areas and are intended to simplify compliance, reduce burdens on businesses and support European competitiveness, while leaving the core structure and purpose of the legislation largely intact. Among the most notable changes is the addition of a ban on AI systems that generate or manipulate non-consensual intimate imagery, applicable from December 2026, with providers of general-purpose AI systems expected to implement robust technical safeguards to prevent such outputs. Compliance deadlines for high-risk AI systems have been pushed back, with Annex III systems now subject to a December 2027 deadline and Annex I systems facing an August 2028 deadline, representing a 16-month extension. The watermarking and output detection obligation under Article 50 has been delayed by four months to December 2026 for providers who placed their systems on the market before August 2026, though new systems must still comply from August 2026. Registration requirements for AI systems that fall outside the high-risk classification have been streamlined, reducing the amount of information providers must submit to the EU public database, though the registration obligation itself remains. The AI literacy obligation has also been softened, shifting from a requirement to ensure a sufficient level of literacy among staff to one of supporting its development, with organisations no longer expected to guarantee the literacy level of any particular individual.

On the processing of sensitive personal data, the amendments expand the existing legal basis beyond providers of high-risk AI systems to include deployers of such systems, as well as providers and deployers of AI systems and models that are not classified as high-risk, provided the processing is strictly necessary for bias detection and correction and the required safeguards are observed. Regarding regulatory oversight, the European AI Office is being granted exclusive competence over AI systems built on general-purpose AI models where the same provider developed both, streamlining enforcement and reducing the risk of simultaneous investigations by multiple regulators, though several categories of AI system remain subject to member state oversight. On proportionality, the favourable inverse penalty regime previously available only to small and medium-sized enterprises is being extended to small mid-cap enterprises, alongside simplified technical documentation requirements, reflecting broader European policy goals around reducing regulatory burden and encouraging innovation. For high-risk AI systems governed by product safety laws listed in Annex I Section A, the European Commission will gain the power to waive certain EU AI Act requirements where an equivalent or higher level of protection already exists under the applicable product safety law, with delegated acts due by August 2027. Finally, the Machinery Regulation is being moved from Section A to Section B of Annex I, meaning that providers of AI-enabled machinery will primarily look to the Machinery Regulation rather than the EU AI Act for their compliance obligations, though such systems remain classified as high-risk.

Real-world data rarely behaves as neatly as textbook examples suggest, and data scientists frequently encounter outliers, skewed distributions and unequal variances that cause standard statistical tests to break down. Rather than discarding problematic data, the solution lies in applying robust statistical methods, which are designed to produce reliable results even when classical assumptions are violated.

Using Python's Pingouin library and a wine quality dataset as a practical playground, three common failure scenarios are explored alongside their robust remedies. When normality tests fail, the Mann-Whitney U test offers a rank-based alternative to the t-test that neutralises the distorting influence of outliers. When paired measurements are not normally distributed, the Wilcoxon Signed-Rank Test provides a dependable substitute for the paired t-test by ranking absolute differences rather than relying on raw values. Finally, when unequal variances undermine a one-way ANOVA, Welch's ANOVA compensates by penalising high-variance groups to ensure fairer comparisons across categories. The broader point is that analytical competence is not about having clean data but about knowing which methods to reach for when the data refuses to cooperate.

TOON offers a more efficient alternative to JSON for structured data input in large language model pipelines by reducing token overhead through compact, tabular formatting that eliminates repetitive field names while preserving data integrity. Designed for scenarios involving repeated structured records such as user entries or support tickets, it streamlines input without requiring changes to existing JSON-based systems, with the recommendation to retain JSON for application logic and outputs while using TOON for prompt context. Its effectiveness depends on data structure, making it most beneficial for uniform arrays of objects rather than deeply nested or irregular data and practical adoption involves testing token savings, latency and model performance in specific workflows before implementation.

Self-hosting large language models presents significant operational challenges that extend beyond initial expectations, encompassing hardware limitations, quantisation trade-offs, context window constraints, latency issues and the complexities of prompt engineering. While the promise of self-hosting includes control and reduced dependency on external APIs, practical implementation often reveals gaps in computational resources, with models requiring substantial VRAM and facing performance compromises when scaled.

Quantisation, though a common solution for hardware constraints, can degrade model accuracy in tasks requiring precision, necessitating empirical testing to balance efficiency and reliability. Context windows, frequently underestimated, impose practical limits on input length, compelling users to adopt strategies like aggressive chunking and selective content inclusion. Latency, particularly in interactive applications, can hinder usability, demanding investments in hardware or optimised frameworks.

Additionally, differences in prompt templates across models can lead to unexpected outputs, highlighting the need for careful configuration. Fine-tuning, while theoretically appealing, demands high-quality data and significant computational effort, often yielding better results from curated examples than large volumes of noisy data. Despite advancements in tooling that have lowered entry barriers, the process remains demanding, requiring patience and iterative refinement to achieve reliable performance.