News Aggregator


Essential Skills for Modern Machine Learning Engineers: A Deep Dive

Aggregated on: 2023-12-27 19:27:58

Machine Learning specialists are at the forefront of the digital transformation of the global economy today; they face a rapidly evolving technology environment that requires a wide range of professional skills. The role of an ML Engineer tasked with transforming theoretical data science models into scalable, efficient, and robust applications can be especially demanding. A professionally savvy ML Engineer has to combine proficiency in programming and algorithm design with a deep understanding of data structures, computational complexity, and model optimization. However, there is a pressing issue in the field: many ML Engineers have critical gaps in their core competencies. Despite mastering essentials like a working knowledge in Classical ML, Deep Learning and proficiency in ML frameworks, they often overlook other vital, even indispensable, areas of expertise. Nuanced programming skills, a solid understanding of mathematics and statistics, and the ability to align machine learning objectives with business goals are some of such areas.

View more...

How To Select the Right Vector Database for Your Enterprise GENERATIVE-AI Stack

Aggregated on: 2023-12-27 16:42:58

Due to the surge in large language model adoption in the Enterprises, GENERATIVE AI has opened a new pathway to unlock the various business potentials and use cases. One of the main architectural building block for GENERATIVE AI is the semantic search powered by the Vector database. Semantic search, as the name suggests is, essentially involves a "nearest neighbor" (A-NN or k-NN) search within a collection of vectors accompanied by metadata. This system having an index to find the nearest vector data in the vector storage is called Vector Database where query results are based on the relevancy of the query and not the exact match. This technique is widely used in the popular RAG (Retrieval Augmented Generation) pattern where the a similarity search is performed in the Vector database based on the user's input query, and the similar results or relevant information is augmented to the input of an Large Language Model so that the LLM doesn't hallucinate for a query outside of its knowledge boundary to generate an unique response for the user. This popular GENERATIVE AI based pattern called, RAG can't be implemented without the support of Vector database as one of the main core component in the architecture. Because of more and more increase in GENERATIVE-AI use cases, as an engineer working on transitioning an LLM-based prototype to production, it is extremely crucial to identify the right vector database during early stage of development.  During the proof-of-concept phase, the choice of database may not be a critical concern for the engineering team. However, the entire perspective changes a lot as the team progresses toward the production phases. The volume of Embedding/vectors data can expand significantly as well as the requirement to integrate the security and compliance within the app. This requires a thoughtful considerations such as access control and data preservation in case of server failures. In this article we will explain a framework and evaluation parameters which should be considered while making the right selection of the Enterprise grade Vector database for the GENERATIVE-AI based use case considering both the Developer Experience as well as the technological experience combining into the Enterprise experience. We also need to keep in mind that numerous vector db products are available in the markets with closed or open source offering and, each catering to a specific use case, and no single solution fits all use cases. Therefore, it's essential to focus on the key aspects when deciding the most suitable option for your GENERATIVE AI based application.

View more...

Offline Data Pipeline Best Practices Part 1:Optimizing Airflow Job Parameters for Apache Hive

Aggregated on: 2023-12-27 15:27:58

Welcome to the first post in our exciting series on mastering offline data pipeline's best practices, focusing on the potent combination of Apache Airflow and data processing engines like Hive and Spark. This post focuses on elevating our data engineering game, streamlining your data workflows, and significantly cutting computing costs. The need to optimize offline data pipeline optimization has become a necessity with the growing complexity and scale of modern data pipelines. In this kickoff post, we delve into the intricacies of Apache Airflow and AWS EMR, a managed cluster platform for big data processing. Working together, they form the backbone of many modern data engineering solutions. However, they can become a source of increased costs and inefficiencies without the right optimization strategies. Let's dive into the journey to transform your data workflows and embrace cost-efficiency in your data engineering environment.

View more...

The New Frontier in Cybersecurity: Embracing Security as Code

Aggregated on: 2023-12-27 15:27:58

How We Used to Handle Security A few years ago, I was working on a completely new project for a Fortune 500 corporation, trying to bring a brand new cloud-based web service to life simultaneously in 4 different countries in the EMEA region, which would later serve millions of users. It took me and my team two months to handle everything: cloud infrastructure as code, state-of-the-art CI/CD workflows, containerized microservices in multiple environments, frontend distributed to CDN, and tests passing in the staging environment. We were so prepared that we could go live immediately with just one extra click of a button. And we still had a whole month before the planned release date.

View more...

Embracing GraphQL: A Paradigm Shift in API Development

Aggregated on: 2023-12-27 13:42:58

Have you heard of GraphQL? This API query language, initially developed by Facebook (now Meta), has evolved into a thriving ecosystem. Explore this article to understand why embracing this new API paradigm is essential. Complex Software Engineering Poses New Challenges API Schema When managing traditional REST APIs, tools like OpenAPI or Postman are typically employed to handle API schemas. This approach, independent of the API itself, relies entirely on the developer's knowledge and expertise in deciding whether to provide these descriptive files and how to do so correctly.

View more...

PostgresML: Extension That Turns PostgreSQL Into a Platform for AI Apps

Aggregated on: 2023-12-27 13:27:58

PostgresML is an extension of the PostgreSQL ecosystem that allows the training, fine-tuning, and use of various machine learning and large language models within the database. This extension turns PostgreSQL into a complete MLOps platform, supporting various natural language processing tasks and expanding Postgres's capabilities as a vector database. The extension complements pgvector, another foundational extension for apps wishing to use Postgres as a vector database for AI use cases. With pgvector, applications can easily store and work with embeddings generated by large language models (LLMs). PostgresML takes it further by enabling the training and execution of models within the database.

View more...

Microservices Resilient Testing Framework

Aggregated on: 2023-12-27 12:57:58

Resilience refers to the ability to withstand, recover from, or adapt to challenges, changes, or disruptions. As organizations increasingly embrace the microservices approach, the need for a resilient testing framework becomes important for the reliability, scalability, and security of these distributed systems. MRTF is a collaborative, anticipatory, and holistic approach that brings together developers, quality assurance professionals, operations teams, and user experience designers. In this article, I delve into the key principles that underpin MRTF, exploring how it integrates into a cohesive framework designed to navigate the intricacies of microservices testing. What Is MRTF? The Microservices Resilient Testing Framework (MRTF) goes beyond the surface, examining the intricate interactions between microservices, considering the entire ecosystem, and anticipating future challenges in microservices development. From preemptive problem-solving to the continuous iteration of testing practices, MRTF encapsulates a comprehensive approach that ensures microservices architectures are rigorously tested for reliability, scalability, and overall user satisfaction. In embracing a holistic and collaborative approach, let’s start by explaining the cornerstones of MRTF.

View more...

AWS CDK Deep Dive: Advanced Infrastructure as Code Techniques With Typescript and Python

Aggregated on: 2023-12-26 13:57:57

Infrastructure as Code (IaC) has become a key aspect of modern cloud computing. It ensures quick, consistent, and repeatable infrastructure deployment. In this context, AWS Cloud Development Kit (CDK) stands out by enabling developers to define cloud infrastructure using familiar programming languages. This post will deeply dive into advanced techniques for using the AWS CDK with TypeScript and Python, two of the most popular programming languages. Understanding AWS CDK What Is AWS CDK? The AWS Cloud Development Kit (CDK) is an open-source software development framework to model and provision your cloud application resources using familiar programming languages. Provisions of cloud applications can be done through AWS CDK in languages familiar to the developer, like TypeScript and Python, extending the flexibility and functionality that may not be present in a simple JSON/YAML-based CloudFormation.

View more...

Contact Center Feature Flags Using AWS Appconfig

Aggregated on: 2023-12-25 21:42:57

This article explains the utilization of AWS AppConfig for managing Amazon Connect cloud contact center IVR experiences/features, consideration, benefits & technical implementation. This technical article intends to provide a solution recommendation to release a new contact center feature in production safely in a controlled manner.  Releasing New Feature To release a new IVR feature in production, the feature management solution must support the following requirements.

View more...

Improving API Error Responses With the Result Pattern

Aggregated on: 2023-12-25 08:42:56

In the expanding world of APIs, meaningful error responses can be just as important as well-structured success responses. In this post, I’ll take you through some of the different options for creating responses that I’ve encountered during my time working at Raygun. We’ll go over the pros and cons of some common options, and end with what I consider to be one of the best choices when it comes to API design, the Result Pattern. This pattern can lead to an API that will cleanly handle error states and easily allow for consistent future endpoint development. It has been particularly useful to me while developing the recently released Raygun API Project, where it has allowed for faster development of endpoints by simplifying the code needed to handle error states. What Defines a “Useful” Error Response? A useful error response provides all the information a developer needs to correct the error state. This can be achieved through a helpful error message and consistent use of HTTP status codes.

View more...

PostgreSQL as a Vector Database: Getting Started and Scaling

Aggregated on: 2023-12-25 07:57:56

PostgreSQL has a rich ecosystem of extensions and solutions that let us use the database for general-purpose AI applications. This guide walks you through the steps required to build generative AI applications using PostgreSQL as a vector database. We'll begin with the pgvector extension, which enables Postgres with the capabilities specific to vector databases. Then, we'll review methods to enhance the performance and scalability of AI apps running on PostgreSQL. In the end, we'll have a fully functional generative AI application recommending Airbnb listings to those traveling to San Francisco.

View more...

Five Apache Projects You Probably Didn’t Know About

Aggregated on: 2023-12-25 06:42:56

In early 2021, I started to work on the Apache APISIX project. I have to admit that I had never heard about it before. In this post, I'd like to introduce some Apache projects that are less well-known than HTTPD or Kafka. Apache APISIX

View more...

Optimization of I/O Workloads by Profiling in Python

Aggregated on: 2023-12-24 09:27:56

Optimizing I/O workloads in Python typically involves understanding where the bottlenecks are and then applying strategies to reduce or manage these bottlenecks. Profiling is a crucial step in this process as it helps identify the parts of the code that are most resource-intensive. Here's a step-by-step guide to optimizing I/O workloads by profiling in Python: Identify the I/O Workloads Comprehending the type of your I/O workloads is essential as a first step. Do they involve disk I/O, such as file read/write operations, network I/O, which includes data transmission over a network, or database I/O, comprising database interactions? Distinct optimization techniques apply to each category. I have taken up the I/O bottlenecks related to Network and file read/write operations for this article.

View more...

Navigating the Technological Landscape of FinTech

Aggregated on: 2023-12-24 08:57:56

With 2024 in full swing, the landscape for developers and engineers is evolving at an unprecedented pace. Especially for those in FinTech, where cybersecurity is top of mind and while many companies rush to adopt AI to cut costs. What does all of this mean for the backbone of these organizations - their technical talent?  In this article, I explore the pivotal trends that will define the year ahead, offering a compass for technologists to not just navigate but lead in the evolution.

View more...

Composing Custom Annotations in Spring

Aggregated on: 2023-12-24 08:42:56

Spring, a widely embraced Java framework, empowers developers with a versatile toolkit to build robust and scalable applications. Among its many features, custom annotations are a powerful mechanism for enhancing code readability, reducing boilerplate, and encapsulating complex configurations. This article will explore the art of composing custom annotations in Spring, unraveling their potential through practical examples. The Essence of Custom Annotations Annotations in Java serve as a form of metadata, offering a way to add supplementary information to code elements. While Spring provides an array of built-in annotations, creating custom annotations allows developers to tailor their applications precisely to their needs.

View more...

Best Practices: Maximizing AI Revenue Growth With Customer Success

Aggregated on: 2023-12-23 18:42:55

In the world of artificial intelligence, maximizing revenue growth is of great importance for businesses seeking to capitalize on their AI products. Like all SaaS tools, the defining linchpin in widespread product adoption is the end user experience. There is an intricate relationship between customer success and how to make money from AI products, as the successful integration of AI products into a given market relies heavily on not only the technological capabilities of the solution but also on how effectively businesses cater to their customers. The intersection of customer success with how to make money from AI offerings is a strategic balance where technology meets user satisfaction and drives business growth. As businesses introduce AI products to the market, an emphasis on customer success becomes a differentiator. Customer success practices — including personalized onboarding, continuous support, and proactive engagement — are not just ancillary components of CS success. They’re integral elements that ensure users derive optimal value from AI solutions, encouraging customer satisfaction and lowering churn.

View more...

REST Clients With OpenFeign: How to Implement Them

Aggregated on: 2023-12-23 18:42:55

In previous posts, we have seen how to implement distributed configuration and service discovery in Spring Cloud. In this article, we will discuss how to implement REST calls between microservices. We will implement REST clients with OpenFeign software. Services Communication There are two main styles of service communication: synchronous and asynchronous. The asynchronous type involves calls where the thread making the call does not wait for a response from the server and is not blocked. A typical protocol used for such scenarios is AMQP. This protocol involves messaging architectures, with message brokers like RabbitMQ and Apache Kafka. 

View more...

Extending Q-Learning With Dyna-Q for Enhanced Decision-Making

Aggregated on: 2023-12-22 20:57:55

Introduction To Q-Learning Q-Learning is a crucial model-free algorithm in reinforcement learning, focusing on learning the value, or 'Q-value', of actions in specific states. This method excels in environments with unpredictability, as it doesn't need a predefined model of its surroundings. It adapts to stochastic transitions and varied rewards effectively, making it versatile for scenarios where outcomes are uncertain. This flexibility allows Q-Learning to be a powerful tool in scenarios requiring adaptive decision-making without prior knowledge of the environment's dynamics. Learning Process:  Q-learning works by updating a table of Q-values for each action in each state. It uses the Bellman equation to iteratively update these values based on the observed rewards and its estimation of future rewards. The policy – the strategy of choosing actions – is derived from these Q-values.

View more...

Secure Password Hashing in Java: Best Practices and Code Examples

Aggregated on: 2023-12-22 20:42:55

In the domain of digital security, password hashing stands as a critical line of defense against unauthorized access. However, the landscape of hashing algorithms has evolved significantly, with some methods becoming obsolete and newer, more secure techniques emerging. This article delves into why traditional methods like SHA-512 are no longer sufficient, the importance of salting and slowing down hashing processes, and provides practical Java code examples for modern password hashing techniques. The Inadequacy of SHA-512 for Password Hashing SHA-512, part of the SHA-2 family, is a cryptographic hash function that was once a standard for securing passwords. However, it's now considered inadequate for password hashing due to:

View more...

Cloud Computing Trends For 2024

Aggregated on: 2023-12-22 20:12:55

As we approach 2024, the cloud computing landscape is on the cusp of significant changes. In this article, I explore my predictions for the future of cloud computing, highlighting the integration of Generative AI Fabric, its application in enterprises, the advent of quantum computing with specialized chips, the merging of Generative AI with edge computing, and the emergence of sustainable, self-optimizing cloud environments. Generative AI Fabric: The Future of Generative AI Cloud Architecture The Generative AI Fabric is set to become a crucial architectural element in cloud computing, functioning as a middleware layer. This fabric will facilitate the operation of Large Language Models (LLMs) and other AI tools, serving as a bridge between the technological capabilities of AI and the strategic business needs of enterprises. The integration of Generative AI Fabric into cloud platforms will signify a shift towards more adaptable, efficient, and intelligent cloud environments, capable of handling sophisticated AI operations with ease.

View more...

Navigating the Tech Landscape: Reflections on 2023 and Predictions for 2024

Aggregated on: 2023-12-22 20:12:55

In the ever-evolving world of technology, staying ahead of the curve is paramount. Steve Santamaria, CEO of Folio Photonics, reflects on the key developments that shaped 2023 and offers insightful predictions for 2024. From active archiving to green data centers and the resurgence of optical storage, Santamaria's observations provide a roadmap for developers, engineers, and architects navigating the complex intersection of technology, business, and environmental responsibility. Reflections on 2023 Active Archiving Takes Center Stage:

View more...

AI Is Transforming How We Use Software Diagrams

Aggregated on: 2023-12-22 18:57:55

Everywhere we look, artificial intelligence (AI) tools are changing the game for developers. These tools often bring promise for less manual work, greater efficiency, and more time for the strategic tasks we value most. Figure 1: A simple sequence diagram showing the interaction between a developer, a codebase, and an AI system

View more...

Running LLMs Locally: A Step-by-Step Guide

Aggregated on: 2023-12-22 18:42:55

In this post, you will take a closer look at LocalAI, an open-source alternative to OpenAI that allows you to run LLMs on your local machine. No GPU is needed: consumer-grade hardware will suffice. Enjoy! Introduction OpenAI is a great tool. However, you may not be allowed to use it due to company policies because you might send sensitive information to OpenAI. Besides that, you might want to experiment with different kinds of LLMs (Large Language Models). Wouldn’t it be great if you could run models locally using the same Rest API as for OpenAI? Well, that is exactly what LocalAI has to offer you! LocalAI is an open-source alternative to OpenAI and has a Rest API which is compatible with the OpenAI API specifications. Besides that, no GPU is needed, you can run it on consumer-grade hardware. It is advised, however, to use a GPU, because it will be approximately 20 times faster.

View more...

How To Create Your Own AI Bot Like ChatGPT and Monetize It

Aggregated on: 2023-12-22 16:57:55

I remember hiring freelancers for content writing, A/B testing, SEO, and many other gigs that were supposed to be the work of ‘professionals’ and ‘experienced individuals.’ But I don’t see it happening in the future.

View more...

Liferay Tutorial for CTOs

Aggregated on: 2023-12-22 16:42:55

Most projects start with a specific business concept, and it wasn’t any different in our case. We needed to develop a system that would allow the client’s employees to display and manage various content (blog posts, newsletters, information about contests, etc.). We also needed to create a user hierarchy structure that would reflect the company’s organization, on the basis of which permissions would be granted for the specific parts of the aforementioned content. Of course, every user would also be required to log in to their account, and the administrator had to have the ability to manage the users, content, and permissions.  The software also had to be integrated with external systems, and last but not least, we needed to pay attention to the general look and feel of the portal, as it would be available for a big audience.

View more...

The Art of Coding and Programming in Integrated Circuit Chips

Aggregated on: 2023-12-22 16:42:55

In an era dominated by digital technology, Integrated Circuit (IC) chips form the backbone of countless devices, from smartphones to sophisticated medical equipment. These microscopic marvels are the result of meticulous programming and coding, a process as intricate as the chips themselves. Understanding the art of IC chip programming is essential to appreciate how these tiny components power our modern world. Background of IC Chips Integrated Circuits, or ICs, revolutionized electronics by miniaturizing and integrating components onto a single chip. Invented in the late 1950s, they have evolved from primitive designs to complex systems capable of performing a variety of functions. Today, ICs range from simple microprocessors to sophisticated SoCs (System on Chip), each designed for specific tasks.

View more...

The Transformative Power of ML and AI in Software Development

Aggregated on: 2023-12-22 16:12:55

The realm of software development is undergoing a profound transformation, fueled by the advancements in machine learning (ML) and artificial intelligence (AI). These transformative technologies are not merely providing incremental improvements but are fundamentally reshaping the way software is created, tested, and deployed.  In the ever-evolving landscape of technology, Machine Learning (ML) and Artificial Intelligence (AI) have emerged as powerful catalysts reshaping the realm of software development. These groundbreaking technologies are not merely buzzwords; they represent a paradigm shift in the way developers design, create, and optimize software. This article explores the profound impact of ML and AI on various aspects of software development, from enhancing efficiency and automating processes to enabling unprecedented levels of innovation.

View more...

Implementing Page Object Model for Playwright Tests

Aggregated on: 2023-12-22 16:12:55

Test automation eases the test execution in the software development lifecycle, but it comes with its own set of challenges. One of the most important aspects of writing effective automation suites is their maintainability. To be able to scale the frameworks easily, it is essential to write clear, modular, and segregated scripts to minimize inter-dependence. If the scripts are written without any format, it can lead to a lot of overhead in their maintenance. This is where the Page Object Model comes to the rescue. In this article, we will be discussing the Page Object Model and how we can leverage its benefits in Playwright tests. What Is a Page Object Model? Page Object Model, or POM is an automation pattern that helps to create reusable components by encapsulating elements of a web page along with their interactions in a single class. These classes are a representation of each web page of the application and serve as reusable components.

View more...

Generative AI Takes Center Stage at AWS Re: Invent 2023

Aggregated on: 2023-12-22 15:12:55

The AWS re: Invent 2023 conference was a melting pot of innovation, especially in the field of generative AI. This year, the event spotlighted groundbreaking services like Amazon Bedrock and the AWS Titan Image Generator. Amazon Bedrock, available since October 2023, is reshaping how generative AI applications are developed, offering access to leading foundation models. Its latest capabilities enable more tailored responses and multi-step task execution. Similarly, the AWS Titan Image Generator, a feature exclusive to Amazon Bedrock, is revolutionizing image generation with its advanced editing capabilities and integration of proprietary data. These tools, along with others such as Amazon Q, AWS HealthScribe, Neptune Analytics, and enhancements in Amazon SageMaker, signify a leap in technology and practical application. In this blog, we delve into these services' new capabilities and their impact on various industries, starting with the new features in Amazon Bedrock.

View more...

Difference Between Incremental and Differential Backups in Exchange Server

Aggregated on: 2023-12-22 15:12:55

In Exchange Server, database backup is essential to prevent loss of data in case of disaster or unforeseen incidents, such as power outage, server failure, natural calamities, etc. At the same time, it is also important to decide on the data backup method as it is not practical to take a full data backup every time, considering the resources needed, the time to take backups daily, and the cost. So, you can choose between incremental and differential backup methods for taking frequent and regular database backups in Exchange Server. In this article, we will discuss the differences between incremental and differential backup methods to help you decide which one to choose based on your needs. 

View more...

Are the Fears About the EU Cyber Resilience Act Justified?

Aggregated on: 2023-12-22 14:57:55

On Wednesday, July 19, the European Parliament voted in favor of a major new legal framework regarding cybersecurity: the Cyber Resilience Act (CRA). According to the press release following the vote:

View more...

How To Automate ServiceNow With Selenium

Aggregated on: 2023-12-22 14:57:55

As businesses grow, there is a need to digitize the processes as manual work becomes tedious. For example, a company with 5000+ employees must digitize its IT department for different works like Asset management, IT Operations, queries related to software, managing the Software licenses, etc. ServiceNow, a cloud platform, provides service, operations, and business management solutions that organizations use to manage their digital workflows and streamline their business processes. When it comes to testing ServiceNow, Selenium is a popular choice among organizations. Selenium is a widely used open-source automation testing framework that can be used to test ServiceNow workflows and ensure a high-quality user experience. In this blog, we will learn how to test ServiceNow using Selenium WebDriver to ensure the workflows and applications are working as expected, ultimately improving the overall efficiency and quality of the testing process. So, let’s get started!

View more...

Remote Control With Node.js, React.js, and Raspberry Pi

Aggregated on: 2023-12-22 13:57:55

The appearance of simple and cheap single-board computers (SBC) was a great promoting factor for the IoT world, providing a possibility to develop a wide range of control systems and devices for industrial, domestic, medical, and other usage. Now, everybody can develop stuff they need for their own needs, contribute to the development of public projects, and use products developed by others. In this article, we are going to develop a control system to manage basic garden activities, like watering, illumination, etc. To make our application more flexible and expandable, we will develop it as a layered distributed system of loosely coupled components, communicating with each other via a standard (REST in our case) protocol. We will use well-known enterprise technologies, Node.js and React.js, and a Raspberry Pi Zero device for the sensor layer of our application.

View more...

How Can Data Professionals Increase Conversion Rates in 2024?

Aggregated on: 2023-12-22 13:12:55

We all have mastered the science of maximizing outputs from the given data in the last decade. However, converting that data into meaningful insights is the real challenge and opportunity! Over the years, a swaddle of 3rd party products has claimed higher ROI, either by optimizing ad spending, improving data analysis strategies, or overhauling the backend. And yet, the website conversion rates across all sectors haven’t crossed 2.5% in 2023 If the average user appetite to purchase has increased and the internet bandwidths have improved, why have the conversion rate numbers not improved? This post discusses often-overlooked strategies to improve website conversion rates and how data professionals can help.

View more...

Anticipating the Journey: Launching Your First Open Source Project

Aggregated on: 2023-12-22 13:12:55

I've been deeply immersed in the world of developer products for the past decade, and let me tell you, I've been quite an open-source enthusiast. Over the years, I've had the pleasure (and occasional pain) of shepherding open-source projects of all shapes and sizes. It's almost become a rite of passage in some teams – the moment when your APIs and libraries step into the spotlight. After all, customers want to know what kind of software is going into their code concoctions. But, let's be real, I've also witnessed open-sourcing used as a bit of a smoke-and-mirrors exercise. So, if you're contemplating the daring act of open-sourcing your projects, here are some things to know before you set out. Manage Your Expectations of External Contributions If I had a penny for every open source manager disappointed by unrealistically high hopes of a flood of external contributions, I'd have enough pennies to... well, still not meet those expectations. The truth is the majority of open-source projects never witness a bustling community of external code contributors. Just because your software is popular doesn't guarantee open-source success. Open source is like nurturing a garden; it takes time and effort to grow. Building a community involves shaping your APIs, fine-tuning functionality, defining boundaries, and, yes, managing expectations. Expecting an avalanche of external contributions in the early days is a recipe for disappointment.

View more...

How Michelin Improves Aftermarket Sales and Customer Service With Apache Kafka

Aggregated on: 2023-12-22 12:57:55

Aftermarket sales and customer service require the right information at the right time to make context-specific decisions. This post explains the modernization of supply chain business process choreography based on the real-life use case of Michelin, a tire manufacturer in France. Data Streaming with Apache Kafka enables true decoupling, domain-driven design, and data consistency across real-time and batch systems. Common business goals drove them: Increase customer retention, increase revenue, reduce costs, and improve time to market for innovation. The State of Data Streaming for Manufacturing in 2023 The evolution of industrial IoT, manufacturing 4.0, and digitalized B2B and customer relations require modern, open, and scalable information sharing. Data streaming allows integrating and correlating data in real-time at any scale. Trends like software-defined manufacturing and data streaming help modernize and innovate the entire engineering and sales lifecycle.

View more...

Spotify Backstage: A Unifying Force for Developer Experience

Aggregated on: 2023-12-22 12:12:55

In the fast-paced world of software development, creating a cohesive and collaborative environment is crucial to promoting innovation and driving project success. This is where Backstage.io comes in - an open-source platform that aims to revolutionize the way development teams work together. In this article, we will delve into how Backstage.io serves as a unifying force, improving the overall developer experience by consolidating tools, streamlining workflows, and fostering collaboration throughout the entire development process. The Developer Experience (DevEx) Revolution Defining Developer Experience Developing software requires a lot of tools and processes, and the experience a developer has with them is known as the Developer Experience or DevEx. A good DevEx is crucial for keeping talented developers, maximizing their productivity, and allowing the development teams to concentrate on their core task of creating exceptional software.

View more...

Open Dashboard and Visualization Workshop: Finalizing Perses Dashboard

Aggregated on: 2023-12-21 22:12:54

Back in December of 2022, I started a series taking you on a tour of the Perses project. These articles covered this fairly new open dashboard and visualization project targeting cloud-native environments. I used a getting started workshop to guide you through this series and to provide a hands-on experience for those new to visualizing observability data. In the previous article, you expanded the visualization of data, resulting in a more advanced dashboard. I provided links to the actual online workshop content.

View more...

From J2EE to Jakarta EE

Aggregated on: 2023-12-21 21:12:54

Jakarta EE is a set of specifications: an open-source platform that offers a collection of software components and APIs (Application Programming Interface) for the development of enterprise applications and services in Java. During these last years, Jakarta EE has become one of the preferred frameworks for professional software enterprise applications and services development in Java. There are probably dozens of such open-source APIs nowadays, but what makes Jakarta EE unique is the fact that all these specifications are issued from a process originally called JCP (Java Community Process), currently called EFSP (Eclipse Foundation Specification Process). These specifications, initially called JSR (Java Specifications Request) and now called simply Eclipse specifications, are issued from a consortium, bringing together the most important organizations in today's Java software development field, originally led by the JCP and now stewarded by the Eclipse Foundation.

View more...

Data Store Options for Operational Analytics/Data Engineering

Aggregated on: 2023-12-21 20:42:54

In this article, we will delve into essential concepts within the domain of analytics databases, conducting a comparative analysis of the available offerings for Azure SQL databases based on these foundational principles. Let’s look at some key concepts before we delve into the data storage options in Azure. Clustered Index A B-Tree clustered index organizes rows physically in memory in sorted order, automatically created when the primary key is established. The key advantage of a clustered index lies in the swift searching of a range of values. Internally utilizing a B-Tree data structure, the leaf node of the B-Tree clustered index contains the actual table data. It is important to note that only one clustered index can be created for a table. Non-Clustered Index  A non-clustered index also employs a B-Tree data structure, with the distinction that the leaf node of the B-Tree or non-clustered index contains pointers to the pages containing the actual table data. Unlike a clustered index, a non-clustered index does not organize rows physically in memory in a sorted order. Importantly, it is permissible to create more than one non-clustered index for a table. Clustered Column Store Clustered column-store storage involves organizing all data in a table in a columnar format, significantly compressing the data and facilitating rapid execution of analytical queries and reports. Depending on the data characteristics, data size may be reduced by a factor of 10x to 100x. The clustered column-store model excels in the quick ingestion of substantial data volumes (bulk-load) as large batches exceeding 100,000 rows undergo compression before storage on disk. This model is particularly well-suited for classic data warehouse scenarios. 

View more...

5 Priority Areas That Will Define the Developer’s AI to-do List in 2024

Aggregated on: 2023-12-21 18:12:54

AI adoption continues at an unstoppable pace across countless industry sectors, and for good reason.   AI applications can transform the enterprise with stronger decision support, predictive capabilities, and automation that drastically improve production quality and scale business processes. There are more and more AI products on the market to choose from that streamline this adoption path. Yet, in the rush to implement, organizations can’t afford to skimp on the DevSecOps priorities that will ensure this adoption doesn’t come at the expense of accuracy, accountability, and compliance.    More than any other role in the org chart, the developer is in the hot seat to reconcile this dilemma of taking AI as an investment priority and ensuring the implementation lives up to that investment as an effective, secure, and compliant operation around the use of AI.   With that in mind, here are five priority areas that will define the developer’s to-do list in 2024 when it comes to AI: 

View more...

Augmented Analytics Helps You Tell the Story of Success

Aggregated on: 2023-12-21 16:57:54

When you embark on an analytics deployment, you want to be sure that you get what you need. To achieve the results you want, you must start at the beginning with planning. Understand how and when your organization will use the solution, and assuming you are planning to employ a self-serve augmented analytics solution, be sure that the software and services you choose will address your user needs and the analytical needs of your team and your organization.  ‘When considering a self-serve augmented analytics solution, there are numerous factors to include in your assessment.’ 

View more...

Dynamic Squad Model

Aggregated on: 2023-12-21 16:12:54

The Dynamic Squad model, a software development model, is the modern way of organizing software development teams focusing on a specific set of goal(s). A squad is a small group of people focusing on a particular goal or purpose. The size and lifespan of each squad will be different and will be based on the goal; hence, it's referred to as dynamic. 

View more...

Optimizing Workforce Management Using Oracle Cloud HCM

Aggregated on: 2023-12-21 16:12:54

Oracle Cloud Human Capital Management (HCM) is Oracle’s SaaS (Software as a service) application. It is a comprehensive cloud-based human resources management system that can be used in various industries, including the service industry chains. The integration of Oracle Cloud Human Capital Management (HCM) in the service industry represents a significant advancement in workforce management and operational efficiency. This article explores the multifaceted applications of Oracle Cloud HCM in the service industry, ranging from workforce management to compliance and reporting, and delineates best practices for its effective utilization. Why the Service Industry? The service industry, characterized by its focus on customer interaction, dynamic workforce requirements, and the need for efficient operational processes, greatly benefits from Oracle Cloud HCM's comprehensive suite of tools. This industry, more than others, faces unique challenges such as high employee turnover, diverse workforce management needs, and the necessity for constant alignment with customer expectations and regulatory standards. Oracle Cloud HCM addresses these challenges by streamlining workforce management through advanced scheduling and time-tracking systems, enhancing efficiency, and reducing labor costs. Its robust recruitment and talent management capabilities aid in efficiently managing the high turnover rates, ensuring a steady inflow of skilled personnel. Additionally, the platform's learning management system is crucial for training employees in customer service and compliance with industry-specific regulations, maintaining high service standards.

View more...

Unleashing Generative AI Capabilities: The Power of Large Language Models Explained

Aggregated on: 2023-12-21 15:57:54

While Generative AI is not a new technology, the launch of Generative AI solutions like ChatGPT, Bard, and Midjourney has spiked interest in leveraging Generative AI applications for enterprise and industry-specific use cases. However, the AI models leveraged by these Generative AI applications are trained for general-purpose utility and lack business- and industry-specific knowledge. Companies trying to capitalize on the current trends and transform their business through their emerging AI capabilities are required to take a hybrid approach with their AI strategy to partly leverage existing solutions for general-purpose activities and create their own custom AI solutions specific to their business needs. For companies to create custom Generative AI solutions, they will need to prepare their own language models, trained with proprietary business data. The custom Large Language Models (LLMs) will help companies unleash Generative AI capabilities for their business and provide them a competitive edge.

View more...

Matching Algorithms in Dating Apps

Aggregated on: 2023-12-21 15:57:54

Modern dating apps have long been a familiar part of our daily lives. Ten years ago, Tinder, Mamba, Pure, and others turned traditional ideas about dating and relationships upside down. Whether we like it or not, dating apps have started to directly affect our relationships. Dating for any purpose has become much easier and faster. But will those relationships be successful? To understand whether you should confide your destiny to apps, you need to understand how their matching algorithms work and whether they are actually able to find the right partner for you. My name is Konstantin Berezin. I am a backend developer with ten years of experience, and in this article, I will tell you how everything works.

View more...

Databricks: An Understanding Inside the WH

Aggregated on: 2023-12-21 15:42:54

Below is a summarized write-up of Databricks and my understanding of Databricks. There are many different types of data warehouses in the market, but here, we are just going to focus on Databricks alone.  Databricks is a similar concept to a data catalog using a hive meta store. Your data resides in s3 and not in any storage database that resides inside an HDD or an SSD. 

View more...

Optimizing Success With Data-Driven and Custom Software Development Services

Aggregated on: 2023-12-21 15:12:54

The need for robust and efficient software solutions has never been greater than it is today. And the primary reason? Well, businesses of all scales and across every industry are increasingly turning to specialized software development services to stay ahead in the competitive market.   Read this article further as we delve deep into the realm of software development to understand how custom software development and data-driven approaches, when combined, can be pivotal in modern business success. 

View more...

Why Back Up DevOps Tools: What Is Worth Remembering?

Aggregated on: 2023-12-21 14:57:54

It’s hard to imagine the software development lifecycle (SDLC) without DevOps tools. They are like a gold mine for the developers, as DevOps tools bring automation, improve collaboration between different members of the team, and tweak monitoring and alert systems.  In this blog post, let’s fathom out the importance of DevOps tools backup, especially when it comes to GitHub, Bitbucket, GitLab, and Jira, and the reasons one can use to work on the CTOs, CISOs, Security, and Team Leaders to start protecting the company’s critical apps valuable for DevOps.

View more...

Machine Learning and the Financial Sector: Is It Worth the Troubles?

Aggregated on: 2023-12-21 14:42:54

As technology continues to reshape traditional practices, financial institutions are confronted with the question: Is incorporating machine learning (ML) worth the potential challenges it brings? From enhanced predictive analytics to improved risk management, the promises of machine learning are enticing. According to Havard University, ML can analyze historical data to understand the demand, supply, and inventory, then forecast the future's demand, supply, and inventory. ML can forecast the client's budgets and several other economic indicators, thus helping the business improve its performance.

View more...