News Aggregator

Build End-To-End RAG Applications Using Airbyte and Snowflake Cortex

Aggregated on: Tue Jul 23 2024 16:38:30 GMT+0000 (Coordinated Universal Time)

As a practical example, this article shows how to build an AI Product assistant — an AI chatbot capable of answering product-related questions using data from multiple sources. With the AI Product Assistant, you can ask questions across all your company’s data in one place. You can utilize the Snowflake Cortex destination to load vector data into Snowflake, followed by leveraging Snowflake’s Cortex functions to perform Retrieval-Augmented Generation (RAG). Cortex offers general-purpose ML functions and LLM-specific functions, along with vector functions for semantic search, each backed by multiple models, all without needing to manage or host the underlying models or infrastructure.

Event Sourcing Explained: Building Robust Systems With Immutable Event Logs

Aggregated on: Tue Jul 23 2024 15:53:30 GMT+0000 (Coordinated Universal Time)

An architectural pattern named Event Sourcing is gaining more and more recognition from developers who aim for strong and scalable systems. In this article, we’ll take a closer look at the concept of it: what it entails, its benefits, general flow, and key concepts. Moreover, we will discuss how to implement ES — some details on the technologies that make adoption easy. This article is aimed at software architects, system developers, and project managers who might be contemplating or are already engaged in integrating Event Sourcing into their systems.

AI vs. Human: Who Detects Bugs Better?

Aggregated on: Tue Jul 23 2024 15:08:30 GMT+0000 (Coordinated Universal Time)

Software testing processes are evolving with the interaction of AI technologies. The advancement in AI tech has helped organizations witness improvements in their testing capabilities. Robust testing enables the release of high-quality and reliable products and services, and bug detection assists. Earlier bug detection and reporting processes required intensive manual labor, which was time-consuming and prone to human errors.

Emerging Trends in Data Warehousing: What’s Next?

Aggregated on: Tue Jul 23 2024 15:08:30 GMT+0000 (Coordinated Universal Time)

Data warehousing has been a cornerstone of business intelligence and analytics for decades, providing organizations with a structured way to store, manage, and analyze large volumes of data. However, as technology continues to evolve, so do the capabilities and expectations of data warehousing systems. This article explores the latest advances and future trends in data warehousing technologies, highlighting the innovations that are shaping the next generation of data warehouses. In the era of big data, the traditional data warehouse is undergoing significant changes. The need for real-time analytics, scalability, and integration with disparate data sources has driven the development of new technologies and approaches to data warehousing. Modern data warehouses now leverage cloud computing, artificial intelligence, and advanced data processing techniques to meet the needs of today's data-driven organizations.

Security Challenges in AI-Powered Applications

Aggregated on: Tue Jul 23 2024 14:38:30 GMT+0000 (Coordinated Universal Time)

AI is revolutionizing how Software-as-a-Service (SaaS) applications work, making them more efficient and automated than ever before. However, this rapid progress has opened up a Pandora's box of new security threats. From the sly manipulation of data to the gradual decay of AI models, these vulnerabilities are unique to AI-powered SaaS and need our urgent attention. In this article, we're diving deep into these risks, looking at real-world examples, and discussing practical ways to protect these AI-driven solutions. We'll focus on:

Shadow IT: The Unavoidable Reality and How To Embrace It Safely

Aggregated on: Tue Jul 23 2024 13:53:30 GMT+0000 (Coordinated Universal Time)

In a world where innovation and productivity are paramount, the rise of Shadow IT has become an unavoidable reality for many organizations. A recent survey by Next DLP revealed a startling statistic: 73% of security professionals admitted to using unauthorized SaaS applications in the past year. This finding underscores a critical challenge faced by CISOs, developers, engineers, and architects alike — balancing the need for productivity with the inherent security risks of Shadow IT. Chris Denbigh-White, CISO at Next DLP, offers a refreshing perspective on this dilemma. "The security risk is not knowing what's in use," he explains. Instead of viewing Shadow IT as an insurmountable threat, Denbigh-White advocates for a more nuanced approach.

Dynamic Pricing Implementation: Price Rules and QCP in Salesforce CPQ

Aggregated on: Tue Jul 23 2024 13:08:30 GMT+0000 (Coordinated Universal Time)

In today's rapidly evolving go-to-market landscape, organizations with diverse product portfolios face intricate pricing and discounting challenges. The implementation of a robust, scalable pricing framework has become paramount to maintaining competitive edge and operational efficiency. This study delves into the strategic utilization of Salesforce CPQ's advanced features, specifically price rules and Quote Calculator Plugins (QCP), to address complex dynamic pricing scenarios. This guide presents an in-depth analysis of ten sophisticated use cases, demonstrating how these automation tools can be harnessed to create agile, responsive pricing models. By emphasizing low-code and declarative configuration methodology, this comprehensive guide provides software developers and solution architects with a blueprint to accelerate development cycles and enhance the implementation of nuanced pricing strategies.

The Ultimate 5-Step Guide for Mobile App Testing Automation

Aggregated on: Mon Jul 22 2024 23:08:30 GMT+0000 (Coordinated Universal Time)

The global mobile app market has been growing at more than 11.5% per year and is now worth more than $154.06 billion after the COVID-19 shift toward remote work has increased and time spent online has gone up. With over 10.97 billion mobile connections worldwide, the demand for sophisticated, high-performance B2B and B2C mobile apps is increasing. The main reason for app abandonment is poor user experience. This includes a perplexing UI/UX and an excessive number of bugs. Loading times are slow. Continuous testing for mobile applications is required to ensure that a mobile app functions properly on both iOS and Android. In addition, mobile app testing can be difficult, involving numerous platforms, operating systems, and network connections.

Building Your Own IoT Project: A Step-By-Step Guide

Aggregated on: Mon Jul 22 2024 22:38:30 GMT+0000 (Coordinated Universal Time)

The Internet of Things (IoT) is revolutionizing the way we interact with technology, enabling everyday objects to connect, collect data, and communicate with each other. Whether you’re a tech enthusiast or a beginner, diving into your own IoT project can be both exciting and rewarding. This guide will walk you through the essential steps to build your first IoT project, ensuring you have a solid foundation to explore this fascinating field.

A Hands-On Guide to OpenTelemetry: Using Automatic Instrumentation

Aggregated on: Mon Jul 22 2024 21:08:29 GMT+0000 (Coordinated Universal Time)

Are you ready to start your journey on the road to collecting telemetry data from your applications? Great observability begins with great instrumentation! In this series, you'll explore how to adopt OpenTelemetry (OTel) and how to instrument an application to collect tracing telemetry. You'll learn how to leverage out-of-the-box automatic instrumentation tools and understand when it's necessary to explore more advanced manual instrumentation for your applications. By the end of this series, you'll have an understanding of how telemetry travels from your applications to the OpenTelemetry Collector, and be ready to bring OpenTelemetry to your future projects. Everything discussed here is supported by a hands-on, self-paced workshop authored by Paige Cruze.

Task-Specific Large Language Models Using Distillation

Aggregated on: Mon Jul 22 2024 20:38:30 GMT+0000 (Coordinated Universal Time)

Large Language Models Large language models (LLMs) represent a significant advancement in Artificial Intelligence, particularly in the field of Natural Language Processing. These models are designed to understand, generate, and interact with natural language in a way that closely mimics human communication. Trained on vast datasets comprising text from diverse sources, LLMs learn to recognize patterns, contexts, and nuances within language, enabling them to perform tasks such as translation, summarization, question-answering, and creative writing. Their ability to generate coherent and contextually relevant text makes them valuable tools in various applications, including customer service, content creation, and educational assistance. General-purpose LLMs are powerful and impressive but come with issues like non-determinism in outputs and formatting, and high resource and financial costs. Smaller, task-specific LLMs distilled from larger, general-purpose LLMs can be an attractive option for many tasks.

A Practical Guide To Implementing Adaptive Software Development

Aggregated on: Mon Jul 22 2024 19:08:29 GMT+0000 (Coordinated Universal Time)

As a tech leader in the custom software development industry for over a decade, I’ve seen methodologies evolve and change. One that has particularly caught my attention in recent years is Adaptive Software Development (ASD). This approach is designed to help teams thrive in uncertain and rapidly changing environments. In this guide, I’ll walk you through the principles, benefits, and practical steps for implementing ASD in your projects.

Empowering Developers in Code Security

Aggregated on: Mon Jul 22 2024 18:38:29 GMT+0000 (Coordinated Universal Time)

Effective security requires a shared responsibility model. Developers are already overburdened with their primary tasks of writing code and delivering features, and we think it is not realistic to expect them to know everything about security, be responsible for triaging and handling incidents on their own, or consider all the implications of security. Adding security responsibilities without proper support and integration can lead to frustration, resistance, and, ultimately, a less secure environment. Yet, their involvement in fixing code security issues is crucial and cannot be replaced by security work.

Use Guardrails To Prevent Hallucinations in Generative AI Applications

Aggregated on: Mon Jul 22 2024 17:53:29 GMT+0000 (Coordinated Universal Time)

Guardrails for Amazon Bedrock enables you to implement safeguards for your generative AI applications based on your use cases and responsible AI policies. You can create multiple guardrails tailored to different use cases and apply them across multiple foundation models (FM), providing a consistent user experience and standardizing safety and privacy controls across generative AI applications. Until now, Guardrails supported four policies — denied topics, content filters, sensitive information filters, and word filters. The Contextual grounding check policy (the latest one added at the time of writing) can detect and filter hallucination in model responses that are not grounded in enterprise data or are irrelevant to the users’ query.

Ansible and the Pre-Container Arts

Aggregated on: Mon Jul 22 2024 17:53:29 GMT+0000 (Coordinated Universal Time)

Before containerization made it so easy to prepare images for virtualization, it was quite an art to prepare custom ISO images to boot from CD. Later these images were used to boot virtual machines from. In other words, ISO images were precursors of container images. It is so that I had a couple of unfortunate run-ins with the Windows Docker client. Even when not running any containers, the Windows memory manager would hand it as much memory as possible slowing whatever I was busy with. I hence banned the Windows Docker client from my machine.

Advanced Deployment Strategies

Aggregated on: Mon Jul 22 2024 17:53:29 GMT+0000 (Coordinated Universal Time)

In today's software development and deployment, maintaining agility, stability, and security is crucial. Centralized configuration management and feature flags are tools that help in achieving these goals. Integrating these into an organization’s DevSecOps process provides the flexibility needed to respond to changes quickly and effectively. Feature Flag Driven Development (FFDD) Feature Flag Driven Development (FFDD) is a software development approach that uses feature flags or toggles. These flags help to control the new feature deployments. The main goal of FFDD is to separate the development and release of new features. This provides flexibility to development teams and allows them to roll out features gradually and choose specific user groups to test them.

Alignment Tools

Aggregated on: Mon Jul 22 2024 17:53:29 GMT+0000 (Coordinated Universal Time)

Understanding and implementing the right alignment tools in Agile product development can significantly enhance the effectiveness of your team and organization. Fostering better relationships between stakeholders and teams can ensure strategic clarity, improve adaptability, and maintain a user-centric focus. This article provides actionable insights on leveraging these tools to build trust, enhance collaboration, navigate risks, and maximize value creation. This will ultimately lead to more successful product outcomes aligned with organizational goals.

The Foundation of AI and Analytics Success: Why Architecture Matters

Aggregated on: Mon Jul 22 2024 17:53:29 GMT+0000 (Coordinated Universal Time)

In the rapidly evolving landscape of AI and analytics, the importance of a robust architecture cannot be overstated. As businesses increasingly rely on data-driven insights and AI-powered solutions, the underlying infrastructure that supports these technologies becomes a critical factor in their success. Recently, a panel of experts gathered to discuss architecture's pivotal role in AI and analytics, sharing insights on business drivers, common pitfalls, and innovative solutions. Business Drivers Shaping AI and Analytics Architectures Several essential business requirements are driving the need for advanced AI and analytics architectures:

Enhancing the Visibility of Integration Tests

Aggregated on: Mon Jul 22 2024 17:08:29 GMT+0000 (Coordinated Universal Time)

In modern software development, effective testing plays a key role in ensuring the reliability and stability of applications. This article offers practical recommendations for writing integration tests, demonstrating how to focus on the specifications of interactions with external services, making the tests more readable and easier to maintain. The approach not only enhances the efficiency of testing but also promotes a better understanding of the integration processes within the application. Through the lens of specific examples, various strategies and tools - such as DSL wrappers, JsonAssert, and Pact - will be explored, offering the reader a comprehensive guide to improving the quality and visibility of integration tests.

Improving the Capabilities of LLM-Based Analytics Copilots With Semantic Search and Fine-Tuning

Aggregated on: Mon Jul 22 2024 15:38:29 GMT+0000 (Coordinated Universal Time)

Picture this: You're an analyst drowning in a sea of data, trying to make sense of complex attribution models and customer journeys. Wouldn't it be great if you had a super-smart AI assistant that could instantly answer your questions, generate SQL queries on the fly, and break down complex tabular data? Well, that's exactly what we're working on with Large Language Model (LLM)- based analytics copilots. But as with any cutting-edge tech, it's not all smooth sailing. Let's dive into the challenges we faced and the cool solutions we came up with to make these AI assistants truly shine. The LLM Conundrum: Brilliant, but Flawed First things first: let's talk about why we're so excited about using LLMs in analytics. These language models are like the Swiss Army knives of the AI world – they can tackle a wide range of tasks, from answering questions to generating code. For us analysts, that means:

Variance: The Heartbeat of Agile Metrics

Aggregated on: Sun Jul 21 2024 14:23:29 GMT+0000 (Coordinated Universal Time)

When teams get their variance right, everything else falls into place. Variance is a measure of whether teams are doing what they say they are going to do. A team with high variance is over-committing or under-delivering. A team with low variance is delivering on its plans. In this case, stakeholders can feel confident in the team, the team can celebrate at the end of each sprint, and longer-term planning is likely to be accurate.

Building Database Connections and Migrations in Go With GORM and Goose

Aggregated on: Sat Jul 20 2024 14:08:28 GMT+0000 (Coordinated Universal Time)

Managing database connections and migrations is crucial for any application. In Go, we can leverage powerful libraries such as GORM for ORM functionality and Goose for database migrations. This article walks you through setting up a robust database client, handling migrations, preloading associations, and querying data efficiently. Tutorial Prerequisites Before we dive into the implementation, ensure you have the following installed:

Setting Up a Local Development Environment With IntelliJ, DevContainers, and Amazon Linux 2023

Aggregated on: Fri Jul 19 2024 23:08:28 GMT+0000 (Coordinated Universal Time)

In modern software development, containerization offers an isolated and consistent environment, which is crucial for maintaining parity between development and production setups. This guide provides a comprehensive walkthrough on creating a local development environment using IntelliJ IDEA, DevContainers, and Amazon Linux 2023 for Java development. Why Use DevContainers? What Are DevContainers? DevContainers are a feature provided by Visual Studio Code and other IDEs like IntelliJ IDEA through extensions. They allow you to define a consistent and reproducible development environment using Docker containers. By encapsulating the development environment, you ensure that all team members work in an identical setup, avoiding the "it works on my machine" problem.

Topic Tagging Using Large Language Models

Aggregated on: Fri Jul 19 2024 21:08:28 GMT+0000 (Coordinated Universal Time)

Topic Tagging Topic tagging is an important and widely applicable problem in Natural Language Processing, which involves tagging a piece of content — like a webpage, book, blog post, or video — with its topic. Despite the availability of ML models like topic models and Latent Dirichlet Analysis [1], topic tagging has historically been a labor-intensive task, especially when there are many fine-grained topics. There are numerous applications to topic-tagging, including: Content organization, to help users of websites, libraries, and other sources of large amounts of content to navigate through the content Recommender systems, where suggestions for products to buy, articles to read, or videos to watch are generated wholly or in part using their topics or topic tags Data analysis and social media management — to understand the popularity of topics and subjects to prioritize Large Language Models (LLMs) have greatly simplified topic tagging by leveraging their multimodal and long-context capabilities to process large documents effectively. However, LLMs are computationally expensive and require the user to understand the trade-offs between the quality of the LLM and the computational or dollar cost of using them.

A Guide to Security Controls for Risk-Based API Protection

Aggregated on: Fri Jul 19 2024 19:08:28 GMT+0000 (Coordinated Universal Time)

In the interconnected world of today, APIs (Application Programming Interface) are the invisible bridges that let applications talk to one another. But to those that with great power, there must also come great responsibility! They need to be able to secure these APIs in order to protect the privacy of their own data or user information from would-be attackers. In this post, we are going to navigate risk-based API security controls which are essential in helping you construct more solid and tamper-proof APIs. 1. Threat Modeling for Shift-Left Secure Design Practices Just think of construction projects. It would perform well to find these structural flaws in the blueprint stage rather than after you build it, wouldn't that be even upstanding? Threat modeling is based on the same way of thinking The shift-left mentality, in action, is identifying and remediating security flaws at the earliest possible point — prior to deploying APIs.

Microservice Logs Testing in the Cloud: Important but Often Ignored

Aggregated on: Fri Jul 19 2024 16:08:28 GMT+0000 (Coordinated Universal Time)

Logs of an application are the initial step to start debugging and analysis of issues, so they are quite an important part of the application. However, they are often ignored during the testing phase. As the world is moving to cloud-based microservices, gaining insights into any customer issue heavily relies on logs. If they are not properly structured or don’t contain enough information to analyze the issue, they can be a significant stumbling block for engineers. In this article, we’ll explore why testing microservice logs is crucial and how engineers can ensure logs are up to the mark. Why Logs Matter Logs are the backbone of debugging, monitoring, and security. They help engineers:

Deploy Your Data Pipelines With GitHub Actions

Aggregated on: Fri Jul 19 2024 13:08:28 GMT+0000 (Coordinated Universal Time)

Automate, customize and execute your software development workflows right in your repository with GitHub Actions. You can discover, create, and share actions to perform any job you'd like, including CI/CD, and combine actions in a completely customized workflow. GitHub Actions is a powerful tool for automating software development workflows, and it can also be used to automate data pipeline processes. In this post, we will walk through an example of using GitHub Actions to automate a data pipeline for a simple data analysis project.

Test Smells: Cleaning up E2E Tests

Aggregated on: Fri Jul 19 2024 00:08:27 GMT+0000 (Coordinated Universal Time)

In practical terms, knowing how not to write tests might be as important as knowing how to write them. There are some very helpful chapters on test smells in Gerard Meszaros's book about xUnit patterns — and more great stuff around the internet; however, it's always helpful to have practical examples for particular tech stacks. We've already shown how to clean up unit tests; this time, we'll do JUnit + Selenide end-to-end tests, at the top of the pyramid. We're assuming you're familiar with Selenide, but most stuff here is valid for other stacks, too.

AWS CDK: Infrastructure as Abstract Data Types, Part 3

Aggregated on: Thu Jul 18 2024 22:08:27 GMT+0000 (Coordinated Universal Time)

In this third part of our CDK series, the project cdk-quarkus-s3, in the same GIT repository, will be used to illustrate a couple of advanced Quarkus to AWS integration features, together with several tricks specific to RESTeasy which is, as everyone knows, the RedHat implementation of Jakarta REST specifications. Let's start by looking at the project's pom.xml file which drives the Maven build process. You'll see the following dependency:

How To Think Simple In Java

Aggregated on: Thu Jul 18 2024 20:08:27 GMT+0000 (Coordinated Universal Time)

The programming language Java is recognized globally for its versatility, robustness, and user-friendly nature, making it one of the most widely used languages. Despite its popularity, individuals at all levels of expertise, from beginners to seasoned programmers, may face challenges comprehending the intricacies of Java, perceiving it as intricate and overwhelming. This comprehensive guide has been meticulously crafted to address these challenges by presenting lucid explanations, and practical examples, and placing a strong emphasis on the development of straightforward, elegant code. Upon completion of this guide, you will have gained a comprehensive understanding of how to simplify the process of Java programming. This will enable you to produce code that is not only efficient but also highly readable and easily maintainable.

Oracle Advanced Queue: A Guide

Aggregated on: Thu Jul 18 2024 18:08:27 GMT+0000 (Coordinated Universal Time)

In this article, we'll look at what Oracle advanced queue is, explore some of the use cases, and consider common best practices while implementing queue. Brief Overview of Oracle Advanced Queue (AQ) In a business application, many systems and apps work together to integrate and exchange information. Oracle Advanced Queuing allows asynchronous communication by sending and receiving the message. This enables the message to be seamlessly integrated and stored at the database structure level.

Precision Python: Leveraging mypy and Pylint for Type Safety

Aggregated on: Thu Jul 18 2024 17:08:27 GMT+0000 (Coordinated Universal Time)

Handling Typing in Python by Default Python's dynamic typing is a simple concept by default. It does not enforce explicit type declarations, allowing variables to change types at runtime. The variable type is determined based on its value at any given time, making it easy to understand and work with. Python x = 10 # x is an integer x = "hello" # now x is a string

The Future of AI Art: Exploring the Capabilities of Stable Diffusion Web UI (Automatic 1111)

Aggregated on: Thu Jul 18 2024 16:08:27 GMT+0000 (Coordinated Universal Time)

What Are Stable Diffusion Models and Why Are They Important? Stable diffusion models are used in machine learning, particularly for creating high-quality images, videos, or other types of data. They are based on the principles of diffusion processes, which involve transforming a simple, usually random, initial state into a complex and structured output by gradually refining the state through multiple iterations. Stable diffusion helps simplify many complex use cases, such as image generation, video generation, data augmentation, text-to-image generation, and scientific visualization, such as medical imaging and astronomy. There are various ways to access stable diffusion models, such as cloud-based services, online platforms and APIs, research and academic resources, and Stable Diffusion Web UI (Automatic 1111).

Boomi's API Control Plane: Simplifying API Management for Developers

Aggregated on: Thu Jul 18 2024 13:23:27 GMT+0000 (Coordinated Universal Time)

A New Era of API Management: Centralized Control With Developer Freedom In the ever-evolving landscape of API management, Boomi has introduced a game-changing solution: the API Control Plane. This innovative platform addresses the growing challenges of API sprawl and shadow APIs while offering developers the flexibility they need in today's complex digital environments. Ed Macosky, Boomi's Chief Product and Technology Officer, shared insights on how this new offering is set to revolutionize API management for developers, engineers, and architects. Bridging the Gap in API Management The API management landscape has long been fragmented, with two primary approaches emerging: centralized solutions favored by IT departments and federated tools preferred by developers. This divide has created significant challenges for organizations seeking to maintain control while empowering their development teams.

Feature Flag Tools to Confidently Release New Features

Aggregated on: Thu Jul 18 2024 00:08:27 GMT+0000 (Coordinated Universal Time)

Feature flags offer an excellent way to quickly turn off and on product changes by enabling you to remove and add the code in the software quickly. Marketers or product managers can choose a time and moment to make a feature or function live to win that aha moment. The feature flags are helpful to various departments, including marketing, product, testing, CROs, and development. The number of feature flags can rise quickly as the team realizes their helpfulness and begins to utilize them. To avoid the mismanagement it may create, you need feature flag platforms. A comprehensive space where you can place all your feature flags and manage, modify, and delete them.

AWS CDK: Infrastructure as Abstract Data Types, Part 2

Aggregated on: Wed Jul 17 2024 23:08:27 GMT+0000 (Coordinated Universal Time)

If you're a Java software developer and you weren't living on the planet Mars during these last years, then you certainly know what Quarkus is. And just in case you don't, you may find it out here. With Quarkus, the field of enterprise cloud-native applications development has never been so comfortable and it never took advantage of such a friendly and professional working environment. The Internet abounds with posts and articles explaining why and how Quarkus is a must for the enterprise, cloud-native software developer. And of course, CDK applications aren't on the sidelines: on the opposite, they can greatly take advantage of the Quarkus features to become smaller, faster, and more aligned with requirements nowadays.

Poetry Explained: Perils of the Unpinned Dependencies

Aggregated on: Wed Jul 17 2024 22:08:27 GMT+0000 (Coordinated Universal Time)

Imagine this: You are days away from a release, and your Python codebase is versioned, tagged, and marked as a Release Candidate. Hours from the release, out of nowhere appears a BUG! You set up a War Room, dig through the logs and the code, the team is struggling…and then it hits you: A DEPENDENCY UPDATE! A seemingly minor version bump in a library your code depends on, introduced a breaking change, causing your cautiously crafted codebase into disarray. This problem compounds itself when our project relies on multiple libraries which in turn have their own set of dependencies. In such cases, a single incompatible update can trigger an avalanche of conflicts leading to “Dependency Hell.”

A Comprehensive Guide to MLflow for Machine Learning Lifecycle Management

Aggregated on: Wed Jul 17 2024 21:08:27 GMT+0000 (Coordinated Universal Time)

MLflow is an open-source platform tailored to handle the whole lifecycle of a machine learning process. This guide, starting from novice and ascending to advanced expert, will cover all the vital features while utilizing Python code. By the end of this guide, you will have a comprehensive understanding of MLflow and will be able to manage experiments, package code, manage models, and deploy them. Introduction to MLflow Setting up MLflow From: “MLflow Tracking” to “Querying experiments”

How To Use WebComponents Inside Phoenix LiveView

Aggregated on: Wed Jul 17 2024 20:08:27 GMT+0000 (Coordinated Universal Time)

On August 6, 1991, Berners-Lee published the first website. Yet, today — almost 33 years later, it's harder than ever to build user interfaces for web apps, and we still have no single standardized way to do that. There's a good reason for that — we simply don't know what we may need upfront. When an industrial architect designs a building, he knows his limits — they are defined by physics. But when a web designer creates and describes UI — the possibilities are limitless. And that's a problem for any standardization process. The Web is evolving so fast, that we can't get used to one set of patterns as new ones emerge, and we drop whatever we are working on to embrace new trendy ideas. In fact, the speed of evolution is so fast, that sometimes we drop projects halfway through to rewrite them using a cool new architecture, library, or framework, breaking deadlines, and failing clients and end users in the process. We are striving to provide our users with the best possible experience, be competitive in the market, and also always stay up to date with modern tech.

Mastering Full-Stack Development: A Comprehensive Beginner’s Guide to the MERN Stack

Aggregated on: Wed Jul 17 2024 19:08:27 GMT+0000 (Coordinated Universal Time)

Introduction to MERN Stack Development There are four technologies that, when bought together, are perfect for building robust enterprise web applications: MongoDB, Express.js, React, and Node.js. The combined tech stack is called the MERN stack. The choice of these stacks makes them very powerful for architecting a full-fledged system and provides great flexibility. Components of the MERN Stack MongoDB: A NoSQL database that stores data in JSON-like documents. It is highly scalable and allows for flexible and dynamic data schemas. Express.js: Express is a minimal and flexible Node.js web application framework that provides a robust set of features for web and mobile applications. React: React lets you build user interfaces out of individual pieces called components. Create your own React components like Thumbnail, LikeButton, and Video. Then combine them into entire screens, pages, and apps. Node.js: Node.js is a free, open-source, cross-platform JavaScript runtime environment that lets developers create servers, web apps, command line tools, and scripts. Setting up a MERN Stack Application Make sure you have Node.js and npm (Node Package Manager) installed on your computer before starting to work with the sample code. They are available for download on the official Node.js website.

Dynamic Watermarking With IMGProxy and Apache APISIX

Aggregated on: Wed Jul 17 2024 18:08:27 GMT+0000 (Coordinated Universal Time)

Last week, I described how to add a dynamic watermark to your images on the JVM. I didn't find any library, so I had to develop the feature, or, more precisely, an embryo of a feature, by myself. Depending on your tech stack, you must search for an existing library or roll up your sleeves. For example, Rust offers such an out-of-the-box library. Worse, this approach might be impossible to implement if you don't have access to the source image. Another alternative is to use ready-made components, namely imgproxy and Apache APISIX. I already combined them to resize images on-the-fly.

AI Agentic 101: Understanding Artificial Intelligence Agents

Aggregated on: Wed Jul 17 2024 17:23:27 GMT+0000 (Coordinated Universal Time)

What is agentic AI and how are these autonomous systems revolutionizing industries? How does AI automation of complex tasks improve productivity and facilitate smarter decisions? Why should you need to understand this cutting-edge technology now? The emergence of the term 'Agentic AI' on the internet around 2024 marks a pivotal shift in the discourse on artificial intelligence.

How To Convert Common Documents to PNG Image Arrays in Java

Aggregated on: Wed Jul 17 2024 16:23:26 GMT+0000 (Coordinated Universal Time)

In this article, we’ll learn how to easily convert a wide variety of common document formats to PNG image arrays using a web API in Java. Before we get to the demonstration portion of this article, we’ll first review the common logic behind converting documents to less flexible formats, and we’ll ultimately discuss the benefits PNG format offers over other common formats like PDF or JPG. Why Convert Documents To Inflexible Formats? File formats optimized for document editing and manipulation typically aren’t optimized for efficiency in other scenarios. There’s a long list of arguments to be made in favor of converting such documents to a static format (like PDF) for any scenario other than document editing and manipulation.

An Introduction to GraphQL: Simplifying Data Fetching With Real-World Examples

Aggregated on: Wed Jul 17 2024 15:23:27 GMT+0000 (Coordinated Universal Time)

What Is GraphQL? GraphQL is a query language for your APIs, as well as a runtime for fulfilling those queries with your existing data. In simple words, you describe your data using a schema; you ask for only what you want, and in turn, you get predictable results. By leveraging this technology, it empowers the client to request precisely what they require, according to the defined schema and query. People widely use GraphQL as an alternative to the REST API architecture due to its growing popularity. Key Features of GraphQL Strongly typed schema: GraphQL employs a schema to specify the categories of data that are queryable. This schema functions as a contractual agreement between the client and server, guaranteeing a clear understanding of the requested data and its expected return. Single endpoint: GraphQL APIs use a single endpoint for all queries and mutations, unlike REST APIs. Hierarchical: GraphQL client queries are similar to the JSON data returned by the API, making it simple and intuitive while making the network API call and understanding complex data structures. Client-specified queries: Web or mobile clients have the leverage to specify exactly what they need in terms of data, which reduces the amount of data transferred over the network and improves the overall application performance. Real-time capabilities: With GraphQL subscriptions, clients can receive real-time updates to data. A Simple Example of GraphQL Here is a simple example to demonstrate how GraphQL works. Suppose we have a simple GraphQL server that manages information about books and authors.

The Invisible Artistry of Backend Development

Aggregated on: Wed Jul 17 2024 14:23:26 GMT+0000 (Coordinated Universal Time)

Architecture is often celebrated as a fine art, particularly when a building's aesthetic features stand out. Yet, a beautiful design alone does not guarantee functionality. Architectural design requires a blend of technical precision and artistic vision. The form of a building should directly serve its intended function, illustrating the principle that form should follow function. For example, the Royal Ontario Museum in Toronto, despite its striking appearance, has been criticized as one of the 'worst examples of architecture during the 2000s' due to its impractical interior spaces characterized by awkward corners and slanted walls that compromise usability.

How To Find and Fix Goroutine Leaks in Go

Aggregated on: Wed Jul 17 2024 13:23:26 GMT+0000 (Coordinated Universal Time)

Goroutines are a key feature of the Go programming language, allowing for efficient concurrent programming. However, improper use of goroutines can lead to leaks, where goroutines are left running indefinitely, consuming memory and other resources. This article will guide you through identifying and fixing goroutine leaks, ensuring your Go applications run smoothly and efficiently. Understanding Goroutine Leaks A goroutine leak occurs when goroutines that are no longer needed are not properly terminated. This can happen due to several reasons:

Why the Newest LLMs Use a MoE (Mixture of Experts) Architecture

Aggregated on: Wed Jul 17 2024 12:23:26 GMT+0000 (Coordinated Universal Time)

Specialization Made Necessary A hospital is overcrowded with experts and doctors each with their own specializations, solving unique problems. Surgeons, cardiologists, pediatricians — experts of all kinds join hands to provide care, often collaborating to get the patients the care they need. We can do the same with AI. Mixture of Experts (MoE) architecture in artificial intelligence is defined as a mix or blend of different "expert" models working together to deal with or respond to complex data inputs. When it comes to AI, every expert in an MoE model specializes in a much larger problem — just like every doctor specializes in their medical field. This improves efficiency and increases system efficacy and accuracy.

How To Change an Ansible Namespace With the FQCN Migration Tool

Aggregated on: Wed Jul 17 2024 11:23:26 GMT+0000 (Coordinated Universal Time)

Packaging Ansible Playbooks within a collection is the best way to distribute reusable automation content. To avoid naming conflicts, developers organize collections inside namespaces. Sometimes situations arise where you need to migrate a collection from one namespace to another, such as a personal or community collection graduating to a more well-known or certified namespace. Altering the namespace can be a tedious task. However, the Fully Qualified Collection Name (FQCN) migration tool simplifies this process by utilizing the fqcn_migration command. Employing a straightforward configuration file transforms an entire collection from one namespace to another. This article introduces the tool and demonstrates how to use it.

When Not to Choose Google Apache Kafka for BigQuery

Aggregated on: Wed Jul 17 2024 00:08:26 GMT+0000 (Coordinated Universal Time)

Google announced its Apache Kafka for BigQuery cloud service at its conference Google Cloud Next 2024 in Las Vegas. Welcome to the data streaming club joining Amazon, Microsoft, IBM, Oracle, Confluent, and others. This blog post explores this new managed Kafka offering for GCP, reviews the current status of the data streaming landscape, and shares some criteria to evaluate when Kafka in general and Google Apache Kafka in particular should (not) be used. Welcome Google Apache Kafka to the Data Streaming Club Better late than never… Google announced a brand new Apache Kafka cloud service for GCP at Google Cloud Next 2024. All other leading cloud providers already have one, including AWS, Azure, Oracle, IBM, and Alibaba. Various other software vendors provide Kafka services, including Confluent, Aiven, Redpanda, WarpStream, and many more. Most leverage the open-source Kafka project as its core component, while others re-implement the Kafka protocol.

Oracle SQL: Understanding Execution Plan and Performance Tuning

Aggregated on: Tue Jul 16 2024 23:08:26 GMT+0000 (Coordinated Universal Time)

Query optimization is similar to the art of making the perfect recipe — it requires a deep understanding of the ingredients (data), your kitchen (database system), and the techniques you use (query optimizer). Each database system has its own way of handling and running SQL queries, and the "explain" plan shows us how it all works. By looking at these plans, we can understand the choices made by the optimizer and make improvements to speed up data retrieval. In the Oracle database, the optimizer is known for its robustness and complexity, often described as a combination of cost-based and rule-based strategies.