News Aggregator


A Complete Guide to Cordova Testing

Aggregated on: Mon Apr 24 2023 14:00:20 GMT+0000 (Coordinated Universal Time)

When we think about the idea of an application, one central question constantly trembles: What would be the best platform to develop it for initially? The reason for this question is the highly fragmented market today we live in. Currently, a user has two primary options to operate an application. For example, a ticket booking application can either be opened as a web application on a desktop or a mobile device can be considered for the same process. Users can also download the mobile application if they choose a mobile device. After this, these options divide further. Let’s say they prefer a mobile device to download the application. But then, which operating system are they using? Since Android and iOS have APIs and structure that is poles apart, they need separate applications.

View more...

Generics in Java and Their Implementation

Aggregated on: Mon Apr 24 2023 13:30:20 GMT+0000 (Coordinated Universal Time)

Generics in Java In Java programming, language generics are introduced in J2SE 5 for dealing with type-safe objects. It detects bugs at the compile time by which code is made stable. Any object type is allowed to be stored in the collection before the generic introduction. Now after the generic introduction in the Java programming language, programmers are forced to store particular object types. Advantages of Java Generics Three main advantages of using generics are given below:

View more...

Conditionals In JavaScript

Aggregated on: Mon Apr 24 2023 12:30:20 GMT+0000 (Coordinated Universal Time)

Conditional statements are used for making decisions based on different conditions. Also, conditionals in JavaScript allow you to execute different blocks of code based on whether a certain condition is true or false. Conditions can be implemented using the following ways:

View more...

The Art of Using Checklists In Jira: Best Practices and Examples

Aggregated on: Sun Apr 23 2023 22:00:20 GMT+0000 (Coordinated Universal Time)

You probably have your favorite recipe you like to treat yourself to every once in a while. Would it still be your go-to dish if you were to miss a couple of ingredients while cooking?  A good checklist in Jira can ensure that you and your team are following the recipe to a tee every time.

View more...

IBM App Connect Enterprise Unit and Component Tests

Aggregated on: Sun Apr 23 2023 22:00:20 GMT+0000 (Coordinated Universal Time)

Integration flows often interact with multiple external services such as databases, MQ queue managers, CICS regions, etc., and testing the flows has historically required all of the services to be available when running tests. This provides a high degree of confidence that the flows behave correctly for the tested scenarios, but the number of scenarios that can be tested this way is often too small to provide sufficient confidence that the overall solution will behave correctly in all (or even most) circumstances. Unit testing with mocked services is a common solution to this problem in the application development world, but integration solutions may require an in-between style of testing due to the large number of service interactions and the common re-use patterns seen in the integration world. App Connect Enterprise development started calling these “component tests” some time ago: Unit tests that test slightly larger sections of code and (unlike pure unit tests) are allowed to communicate with external services. This article will attempt to illustrate this approach using a database as an example service.

View more...

Zero Trust Network for Microservices With Istio

Aggregated on: Sun Apr 23 2023 21:30:20 GMT+0000 (Coordinated Universal Time)

Security was mostly perimeter-based while building monolithic applications. It means securing the network perimeter and access control using firewalls. With the advent of microservices architecture, static and network-based perimeters are no longer effective. Nowadays, applications are deployed and managed by container orchestration systems like Kubernetes, which are spread across the cloud. Zero trust network (ZTN) is a different approach to secure data across cloud-based networks. In this article, we will explore how Istio, with ZTN philosophy, can help secure microservices.

View more...

What Is Argo CD? The GitOps Tool for Kubernetes

Aggregated on: Sun Apr 23 2023 17:45:20 GMT+0000 (Coordinated Universal Time)

Argo CD is a continuous delivery (CD) tool that has gained popularity in DevOps for performing application delivery onto Kubernetes. It relies on a deployment method known as GitOps. GitOps is a mechanism that can pull the latest code and application configuration from the last known Git commit version and deploy it directly into Kubernetes resources. The wide adoption and popularity are because Argo CD helps developers manage infrastructure and applications lifecycle in one platform. To understand Argo CD in-depth, we must first understand how continuous delivery works for most application teams and how it differs from GitOps.         

View more...

API Gateway For ChatGPT Plugins

Aggregated on: Sun Apr 23 2023 16:45:20 GMT+0000 (Coordinated Universal Time)

OpenAI has recently launched a new version of ChatGPT which now allows plugins inside ChatGPT. These plugins can be added directly to the chatbot, providing it with access to a wide range of knowledge and information from its third-party partners through the APIs. ChatGPT plugins can extend its functionality and enhance its capabilities to access up-to-date information such as research travel costs, find out discount information, or help you book flights and order food. You can also build your own plugin that allows ChatGPT to call your API data intelligently. Yes, that’s right! To make your data accessible through a ChatGPT custom plugin, ChatGTP requires you to build a new API or use an existing one that can be used to query it and receive its responses. Then it generates a user-friendly answer by combining the API data and its natural language capabilities. In this case, API Gateway can help with improving security, usability, and efficiency. This post explores how API Gateway can be beneficial for ChatGPT plugin developers to expose, secure, manage, and monitor their API endpoints.

View more...

Custom Training of Large Language Models (LLMs): A Detailed Guide With Code Samples

Aggregated on: Sat Apr 22 2023 19:15:19 GMT+0000 (Coordinated Universal Time)

In recent years, large language models (LLMs) like GPT-4 have gained significant attention due to their incredible capabilities in natural language understanding and generation. However, to tailor an LLM to specific tasks or domains, custom training is necessary. This article offers a detailed, step-by-step guide on custom training LLMs, complete with code samples and examples. Prerequisites Before diving in, ensure you have:

View more...

How to Handle Secrets in Jenkins

Aggregated on: Sat Apr 22 2023 18:30:19 GMT+0000 (Coordinated Universal Time)

Jenkins is a popular open-source automation server that is widely used for building, testing, and deploying software. It allows developers to automate many aspects of their software development process, including continuous integration and continuous deployment. As with any continuous integration software, managing secrets in Jenkins is crucial to ensure the security and integrity of the applications being built and deployed. In this article, we will be discussing the best practices for managing secrets in Jenkins, including configuring and managing secrets and how to handle potential security breaches.

View more...

How Midjourney and Other Diffusion Models Create Images from Random Noise

Aggregated on: Sat Apr 22 2023 18:15:19 GMT+0000 (Coordinated Universal Time)

Colossal hype ensues whenever there's progress or even the slightest shift in the world of machine learning (ML). When it comes to AI, the craze always ends up growing out of proportion and insane claims invariably follow. You've probably noticed this recently as more people are beginning to use Midjourney, ChatGPT, Copilot, and so on. The truth about these systems, however, is always more prosaic. Machine learning is mathematical, and the real implications of the ML models are not nearly as profound as some bloggers would have you believe. They could be beneficial and, in some cases, transform large portions of workflows in specific areas, but only if the user, whether an organization or an individual, has a sufficient understanding of their inner workings, limitations, capabilities, and potential.

View more...

MLOps for Beginners: Getting Started With MLOps

Aggregated on: Sat Apr 22 2023 17:30:19 GMT+0000 (Coordinated Universal Time)

Machine learning (ML) has revolutionized various industries by enabling data-driven decision-making along with the automation of certain tasks. For instance, many banking institutions deploy advanced machine-learning models to detect fraudulent transactions. These models need to evolve constantly otherwise there will be a steep rise in false positives. However, deploying new machine learning models in production can be challenging. Training the model on production data, deploying it, and maintaining it isn’t easy. Many a time, machine learning models in production fail to adapt to the changing data and environment. And doing all of it manually isn’t efficient.

View more...

Producing and Consuming Avro Messages With Redpanda Schema Registry

Aggregated on: Fri Apr 21 2023 21:45:19 GMT+0000 (Coordinated Universal Time)

If you’re familiar with Apache Kafka®, then you might have encountered a Kafka-compatible schema registry—a separate component that you deploy outside of your Kafka cluster, since Kafka itself doesn’t have one built-in.  Essentially, a schema is a logical description of how your data is organized, and so a schema registry provides a central repository for those schemas, allowing producers and consumers to seamlessly send and receive data between them. For event-driven architectures, this can become complex and difficult to manage as you scale, since data schemas can change and evolve over time (potentially breaking things down the line). 

View more...

Lambda Architecture: A Powerful Approach to Data Engineering

Aggregated on: Fri Apr 21 2023 20:15:19 GMT+0000 (Coordinated Universal Time)

In the world of big data and analytics, processing and managing vast amounts of data efficiently and effectively is a critical challenge. Data engineers play a pivotal role in designing and implementing solutions to handle this data deluge. One such approach that has gained popularity in recent years is the Lambda Architecture, a powerful framework for building scalable and robust data processing pipelines. In this article, we will explore the Lambda Architecture in detail, understanding its key concepts, benefits, and challenges. What Is Lambda Architecture? The Lambda Architecture is a data processing architecture that combines batch processing with real-time/stream processing to handle large volumes of data in a distributed and fault-tolerant manner. It was introduced by Nathan Marz in his book "Big Data: Principles and best practices of scalable real-time data systems" and has since become a widely adopted approach in the field of data engineering.

View more...

What Is Platform Engineering? How To Get Started

Aggregated on: Fri Apr 21 2023 20:15:19 GMT+0000 (Coordinated Universal Time)

Platform engineering is the discipline of building and maintaining a self-service platform for developers. The platform provides a set of cloud-native tools and services to help developers deliver applications quickly and efficiently. The goal of platform engineering is to improve developer experience (DX) by standardizing and automating most of the tasks in the software delivery lifecycle (SDLC). Instead of context switching like provisioning infrastructure, managing security, and learning curve, developers can focus on coding and delivering the business logic using automated platforms. Platform engineering has an inward-looking perspective as it focuses on optimizing developers in the organization for better productivity. Organizations benefit greatly from developers working at the optimum level because it leads to faster release cycles. The platform makes it happen by providing everything developers need to get their code into production so they do not have to wait for other IT teams for infrastructure and tooling. The self-service platform that makes developers' day-to-day activities more effortless and autonomous is called an internal developer platform (IDP).

View more...

Why Use Kong API Gateway

Aggregated on: Fri Apr 21 2023 19:45:19 GMT+0000 (Coordinated Universal Time)

Kong API Gateway is a cloud-native API gateway that is based on the Nginx reverse proxy. It is a simple, fast, and lightweight solution that enables you to control, set up, and direct application-to-dedicated server request routing. The Kong API Gateway helps regulate who can access the services and data that are managed behind it. It ensures data security by allowing only authorized users and apps to access the data. The Kong API Gateway is highly performant and offers the following features: Request/Response Transformation: Kong can transform incoming and outgoing API requests and responses to conform to specific formats. Authentication and Authorization: Kong supports various authentication methods, including API key, OAuth 2.0, and JWT, and can enforce authorization policies for APIs. Traffic Management: Kong provides traffic management features, such as rate limiting, request throttling, and IP whitelisting, to maintain the reliability and stability of APIs. Monitoring and Logging: Kong offers detailed metrics and logs to help monitor API performance and identify issues. Plugins: Kong has a vast and continuously growing ecosystem of plugins that provide additional functionality, such as security, transformations, and integrations with other tools. Microservice Architecture: Kong is designed to work with microservice architecture, providing a central point of control for API traffic and security. Scalability: Kong is designed to scale horizontally, allowing it to handle large amounts of API traffic. Advantages of Using Kong as an API Gateway Kong API Gateway is an efficient solution for managing APIs that offer advanced routing and management capabilities. With flexible request routing, automatic service discovery, advanced load balancing, comprehensive API management, and real-time analytics and monitoring, organizations can effectively route API traffic, discover and register APIs, distribute traffic across backend services, manage APIs throughout their lifecycle, and gain insight into API performance and usage. These capabilities make Kong a highly effective solution for managing APIs at scale and are essential for organizations looking to build and maintain a robust API infrastructure.

View more...

Okta + SAML + JBoss EAP 6.4.x + Picketlink

Aggregated on: Fri Apr 21 2023 19:15:19 GMT+0000 (Coordinated Universal Time)

In this article, I explain how to provide Okta authentication to your web application hosted on a JBoss EAP 6.4.x server. In this example, we provide authentication to internal users (who are logged in in the customer network) and external users (from the internet) who may be third-party collaborators such as carriers, partners, etc.

View more...

What Is Blue-Green Software Delivery Deployment?

Aggregated on: Fri Apr 21 2023 17:30:19 GMT+0000 (Coordinated Universal Time)

A blue-green deployment model is a software delivery release strategy based on maintaining two separate application environments. The existing production environment running the current production release of the software is called the blue environment, whereas the new version of the software is deployed to the green environment. As part of testing and validation of the new version of the software, application traffic is gradually re-routed to the green environment. If no issues are found, then the green environment becomes the new blue environment. The former blue environment can be taken down, and a new green environment can be established for the next release. Why Is Blue-Green Deployment Useful? The primary benefits of implementing a blue-green strategy are 1) minimal or zero application downtime and 2) no negative impact on end-users when switching users to a new software release or when rolling back a release in the event of unforeseen issues with the new release or deployment.  

View more...

How to Stream Sensor Data to Apache Pinot for Real Time Analysis

Aggregated on: Fri Apr 21 2023 15:30:19 GMT+0000 (Coordinated Universal Time)

This is part 2 of a multi-part sample application that I've been building using Kafka and Apache Pinot. In the first part, we built an NFC Badge Reader to record when badges are swiped. In this part, we will begin ingesting some environmental data from a sensor into the mix. I'm not going to spoil the fun by telling you where this is ultimately headed, but feel free to reach out to me on Twitter and see if you can guess! As always, all of the code is available on GitHub.

View more...

Test Tool Tutorial: A Comprehensive Guide With Examples and Best Practices

Aggregated on: Fri Apr 21 2023 14:30:19 GMT+0000 (Coordinated Universal Time)

Test tools are software or hardware designed to test a system or application. Various test tools are available for different types of testing, including unit testing, integration testing, and more. Some test tools are intended for developers during the development process, while others are designed for quality assurance teams or end users. In addition to automating testing tasks, test tools can produce test data, monitor system performance, and report on test results.

View more...

IoT Testing: How It Works and Why You Can’t Do Without It

Aggregated on: Fri Apr 21 2023 13:30:19 GMT+0000 (Coordinated Universal Time)

The Internet of Things is one of those concepts that seemed like science fiction only a few decades ago but are totally real these days, just like self-driving cars or delivery robots. IoT devices surround us everywhere, and their presence is only becoming more ubiquitous. By 2025, there are projected to be over 75 billion connected IoT devices, and the global IoT revenue is expected to hit $96 billion the same year. The IoT market is a fascinating example of the most advanced use of technology that benefits businesses, regular users, and even whole cities. However, behind every successful Internet of Things product, there are many rounds of testing and quality assurance. In this article, we will talk in detail about IoT testing: what it entails, how to do it the right way, which challenges you can face along the way, and why, despite all challenges, IoT QA is still a critical aspect of creating Internet of Things products.

View more...

Consumer Group in Kafka [Video Tutorials]: Partitions and Consumers

Aggregated on: Fri Apr 21 2023 12:30:19 GMT+0000 (Coordinated Universal Time)

In this video tutorial series, take a deeper look at the consumer group in Kafka with: 1 partition and 2 consumers 2 partitions and 2 consumers 3 partitions and 1 consumer Consumer Group in Kafka With 1 Partition and 2 Consumers In this first Apache Kafka tutorial, learn about Java Kafka consumer code with 1 partition and 2 consumers.

View more...

CockroachDB TIL: Volume 12

Aggregated on: Fri Apr 21 2023 00:15:18 GMT+0000 (Coordinated Universal Time)

Previous Articles Volume 1 Volume 2 Volume 3 Volume 4 Volume 5 Volume 6 Volume 7 Volume 8 Volume 9 Volume 10 Volume 11 Topics Topic 1: Identify partial indexes Topic 2: Capture the DB Console URL with SQL Topic 3: Experimenting with PgCat Topic 4: CockroachDB and pgbench client disconnects Topic 5: CockroachDB and PGSERVICEFILE Topic 1: Identify Partial Indexes Our engineering team has issued a technical advisory #96924 where certain schema changes like dropping columns referenced in partial indexes will fail. A customer asks how to identify databases, tables, and for the associated partial indexes referencing columns to be dropped. The following methods will assist in finding those pesky indexes. Considering a table with the following data:

View more...

[DZone Survey] What’s Your Superpower?

Aggregated on: Thu Apr 20 2023 23:45:18 GMT+0000 (Coordinated Universal Time)

Are you a software developer? If you’re reading this, chances are pretty good the answer is “yes.”  Developers are basically superheroes. They solve problems for ordinary folks, fight off bad guys, and do things (with 1s and 0s) that no one else can. Our job at DZone, as mere mortals, is to help you do your job better by bringing you the best expert content and tools we can — consider us your Alfred.

View more...

Data Encryption: Benefits, Types, and Methods

Aggregated on: Thu Apr 20 2023 20:00:18 GMT+0000 (Coordinated Universal Time)

Data encryption is one of the most prevalent digital safety measures since it safeguards information and reduces the impact of cyber threats. Modern organizations incorporate encryption in various daily activities, such as communication and payments. That said, it is essential to understand how encryption works so you can leverage its capabilities and ensure optimal protection. This post explains data encryption and lists its benefits, types, and the common encryption methods found in different tools.

View more...

Fearless Distroless

Aggregated on: Thu Apr 20 2023 19:30:18 GMT+0000 (Coordinated Universal Time)

With the rise of Docker came a new focus for engineers: optimizing the build to reach the smallest image size possible. A couple of options are available.

View more...

Maximizing the Potential of LLMs: Using Vector Databases

Aggregated on: Thu Apr 20 2023 18:30:18 GMT+0000 (Coordinated Universal Time)

LLMs do Natural Language Processing (NLP) to represent the meaning of the text as a vector. This representation of the words of the text is an embedding. The Token Limit: The LLM Prompting Biggest Problem Currently, one of the biggest problems with LLM prompting is the token limit. When GPT-3 was released, the limit for both the prompt and the output combined was 2,048 tokens. With GPT-3.5, this limit increased to 4,096 tokens. Now, GPT-4 comes in two variants. One with a limit of 8,192 tokens and another with a limit of 32,768 tokens, around 50 pages of text.

View more...

Static Proxies or Rotating Proxies: Which One Should You Choose?

Aggregated on: Thu Apr 20 2023 17:30:18 GMT+0000 (Coordinated Universal Time)

Data center proxies come from servers in data centers, while residential proxies come from real people's connections. Static proxies mostly come from data centers, while rotating proxies are residential, although there are exceptions for Residential proxies. Both IPv4 and IPv6 addresses can supply static and rotating proxies, but static IPv4 proxies may be harder to come by since they've all been assigned. IPv6, on the other hand, has trillions of available IP addresses.

View more...

Benefits of React V18: A Comprehensive Guide

Aggregated on: Thu Apr 20 2023 14:15:18 GMT+0000 (Coordinated Universal Time)

React v18 has finally been released after being talked about since 2021. React v18 brings exciting new features to improve performance and the user experience. The main emphasis of this release was the introduction of concurrent Mode, new hooks, and improvements to React’s strict mode API.  The information in this article is organized based on the table presented by Shruti Kapoor at the Reactathon 2022 conference. It will cover three key features of React v18: automatic batching, transition, and suspense on the server. It will also touch on the concept of concurrency and the new APIs introduced in React DOM Client and Server. Lastly, it will also introduce the new hooks available in React v18, including useId and useTransition.

View more...

Kafka: The Basics

Aggregated on: Thu Apr 20 2023 13:45:18 GMT+0000 (Coordinated Universal Time)

Data synchronization is one of the most important aspects of any product. Apache Kafka is one of the most popular choices when designing a system that expects near-real-time propagation of large volumes of data. Even though Kafka has simple yet powerful semantics, working with it requires insight into its architecture. This article summarizes the most important design aspects of Kafka as a broker and applications that act as data producers or consumers. About Kafka Apache Kafka originated on LinkedIn and was developed as a highly scalable distribution system for telemetry and usage data. Over time, Kafka evolved into a general-purpose streaming data backbone that combines high throughput with low data delivery latencies. Internally, Kafka is a distributed log. A (commit) log is an append-only data structure to whose end the producers append the data (log records), and subscribers read the log from the beginning to replay the records. This data structure is used, for example, in the database write-ahead log. Distributed log means that the actual data structure is not hosted on a single node but is distributed across many nodes to achieve both high availability and high performance.

View more...

AWS: Pushing Jakarta EE Full Platform Applications to the Cloud

Aggregated on: Thu Apr 20 2023 03:15:18 GMT+0000 (Coordinated Universal Time)

In a previous blog post, I demonstrated how to deploy Jakarta EE applications as serverless services with AWS Fargate. The Jakarta EE application I used as an example in the previously mentioned post was a basic one. Now, it's time to go further and see what it takes to do the same thing with more complex Jakarta EE applications involving a wide variety of components like RESTful, CDI, Enterprise Beans, and Server Pages. Jakarta EE Full Platform is the superset of what has been commonly called "enterprise Java." While not officially coined as a Jakarta EE profile, such as the Core Profile or the Web Profile, the Full Platform includes the whole bunch of the Jakarta EE specifications implementations, from the most essential ones, like Servlet, to the most uncharted ones, like RMI or SAAJ.

View more...

Web3 Onboarding Is Terrible: How To Make It Better With Account Abstraction and Flow

Aggregated on: Thu Apr 20 2023 03:15:18 GMT+0000 (Coordinated Universal Time)

If you’re a developer working on a web3 app, you know that onboarding mainstream users into web3 is difficult. Even with the promise of truly owning your data, making near-free worldwide payments, and using a censorship-free system, the current process of creating and using a digital wallet is just too hard. 

View more...

GitStream vs. Code Owners vs. GitHub Actions

Aggregated on: Thu Apr 20 2023 02:15:18 GMT+0000 (Coordinated Universal Time)

Code review is an essential part of all your software development projects. But sometimes, your org follows an inefficient PR process, applying the same sets of policies to every pull or merge request, regardless of the change. This can increase the lead time from making a change to releasing it to production. Your teams’ cycle times will also take a massive blow, and your devs will be frustrated.  But new methods are constantly emerging to make the PR lifecycle smoother. These often mix automation and human interaction to reduce the time to merge. In this article, you’ll learn about some of the newer tools that help automate your workflow, including GitHub Actions, code owners, and LinearB’s very own gitStream.

View more...

Continuing Hello World

Aggregated on: Thu Apr 20 2023 02:15:18 GMT+0000 (Coordinated Universal Time)

I taught myself to code from scratch. I just started writing in Basic on my Sinclair when I was in kindergarten and “got it.” I later picked up the books and courses easily without that initial study period of formal training. When I got to advanced academic materials, I already knew pretty much everything. As a matter of fact, I never learned much from teachers. I learned to read mostly on my own and followed through with most disciplines. This isn’t a “brag” because the reason for that is a learning disability. It’s hard for me to understand teachers and communicate with them. This was a problem in my childhood but became a bigger problem when I started to teach programming in a local computer lab at 16. I was a terrible instructor. Typically we would mimic the skills of a good role model when performing a task. I didn’t have any good teachers. At least not good for my learning disability.

View more...

Jira Anti-Patterns

Aggregated on: Thu Apr 20 2023 02:15:18 GMT+0000 (Coordinated Universal Time)

If you ask people to come up with popular attributes for “Agile” or “agility,” Scrum and Jira will likely be among the top ten featured. Moreover, in any discussion about the topic, someone will mention that using Scrum running on top of Jira does not make an organization Agile. However, more importantly, this notion is often only a tiny step from identifying Jira as a potential impediment to outright vilifying it. So, in March 2023, I embarked on a non-representative research exercise to learn how organizations misuse Jira from a team perspective as I wanted to understand Jira anti-patterns. Read on and learn more about how a project management tool that is reasonably usable when you use it out of the box without any modifications turns into a bureaucratic nightmare, what the reasons for this might be, and what we can do about it.

View more...

Recording Badge Scans in Apache Pinot

Aggregated on: Wed Apr 19 2023 23:15:18 GMT+0000 (Coordinated Universal Time)

Go   type Card struct { Badge string `json:"badge"` Time int64 `json:"time"` } About Pinot Apache Pinot®  is a real-time distributed OLAP datastore. It is designed to provide fast aggregation of metrics with large data sets and is optimized for fast ad-hoc queries. Pinot is column-oriented and is optimized for aggregating metrics. It is designed to scale to trillions of rows and can ingest data in real time.

View more...

Integrate Apache Spark and QuestDB for Time-Series Analytics

Aggregated on: Wed Apr 19 2023 21:45:17 GMT+0000 (Coordinated Universal Time)

Spark is an analytics engine for large-scale data engineering. Despite its long history, it still has its well-deserved place in the big data landscape. QuestDB, on the other hand, is a time-series database with a very high data ingestion rate. This means that Spark desperately needs data, a lot of it! ...and QuestDB has it, a match made in heaven. Of course, there are pandas for data analytics! The key here is the expression large-scale. Unlike pandas, Spark is a distributed system and can scale really well.

View more...

Apache Kafka in Java [Video Tutorials]: Architecture and Simple Consumer/Producer

Aggregated on: Wed Apr 19 2023 21:30:17 GMT+0000 (Coordinated Universal Time)

In this video tutorial series on Apache Kafka in Java, explore: Apache Kafka architecture and Apache Kafka components Creating a simple producer and consumer in Java Apache Kafka producer callbacks (producer with and without keys) in Java and Spring Boot Apache Kafka Architecture and Components This Apache Kafka designed for beginners takes a deep look at Kafka architecture and components.

View more...

Introduction to Elasticsearch

Aggregated on: Wed Apr 19 2023 21:30:17 GMT+0000 (Coordinated Universal Time)

What Is Elasticsearch? Elasticsearch is a highly scalable and distributed search and analytics engine that is built on top of the Apache Lucene search library. It is designed to handle large volumes of structured, semi-structured, and unstructured data, making it well-suited for a wide range of use cases, including search engines, log analysis, e-commerce, and security analytics. Elasticsearch uses a distributed architecture that allows it to store and process large volumes of data across multiple nodes in a cluster. Data is indexed and stored in shards, which are distributed across nodes for improved scalability and fault tolerance. Elasticsearch also supports real-time search and analytics, allowing users to query and analyze data in near real time.

View more...

External Data Services Plugin Design in IBM Content Navigator and a Sample Scenario of Implementation

Aggregated on: Wed Apr 19 2023 21:00:17 GMT+0000 (Coordinated Universal Time)

An External Data Services (EDS) plugin in IBM Content Navigator (ICN) is used to integrate external data sources with ICN. An EDS plugin allows ICN to retrieve data from external data sources, such as databases or web services, and display it in ICN. The EDS plugin interface defines the methods that ICN uses to communicate with the plugin, such as initializing the plugin, performing queries, and retrieving data.  The following is an overview of the design considerations for developing an EDS plugin in ICN:

View more...

Step-By-Step Guide to Building a High-Performing Risk Data Mart

Aggregated on: Wed Apr 19 2023 20:30:17 GMT+0000 (Coordinated Universal Time)

Pursuing data-driven management, we aim to serve four needs in our data platform development: monitoring and alerting, query and analysis, dashboarding, and data modeling. For these purposes, we built our data processing architecture based on Greenplum and CDH. The most essential part of it is the risk data mart.  Risk Data Mart:  Apache Hive I will walk you through how the risk data mart works following the data flow: 

View more...

Diving Into Cloud Infrastructure: An Exploration of Its Different Components

Aggregated on: Wed Apr 19 2023 18:45:17 GMT+0000 (Coordinated Universal Time)

Cloud Implementation has become a key component of modern IT systems, enabling organizations to scale their operations and reduce costs. However, managing cloud infrastructure seamlessly and driving a cloud deployment securely is not easy. It requires a deep understanding of the underlying technologies and the right cloud advisory. In this blog, we'll explore the building blocks of cloud infrastructure, including virtualization, containers, microservices, and serverless computing. We'll discuss how these technologies work together to create a flexible, scalable, and cost-effective cloud infrastructure. We'll also discuss the different challenges of managing cloud infrastructure and cloud deployment.

View more...

Agile vs. Scrum

Aggregated on: Wed Apr 19 2023 18:30:17 GMT+0000 (Coordinated Universal Time)

Agile and Scrum are two related concepts that are often used in software development. Agile is an umbrella term encompassing a set of values and principles for software development, while Scrum is a specific framework within the Agile methodology.  Agile emphasizes collaboration, flexibility, and adaptability, as well as the ability to respond to change. It emphasizes, In addition, iterative development and continuous improvement, where teams work in short cycles called sprints, with frequent feedback and re-evaluation. 

View more...

How to Move System Databases to Different Locations in SQL Server on Linux

Aggregated on: Wed Apr 19 2023 17:45:17 GMT+0000 (Coordinated Universal Time)

Linux is a complex operating system, undoubtedly very secure but complex, especially for users who never had experience working on the Linux platform. As you know, the SQL Server on Linux is becoming mature and easy to use. Still, it does not support MMC consoles in Linux which makes the administration of the SQL Server a little bit complicated.  In this article, I will explain how we can move the system databases to different locations in Ubuntu Linux. SQL Server on Linux does not have SQL Server Configuration Manager, so we will use the mssql-config commands to perform administrative tasks. Please note that the operations which we are performing require elevated permissions. I am using root user. So let us begin.

View more...

Tornado vs. FastAPI: Why We Made the Switch

Aggregated on: Wed Apr 19 2023 16:15:17 GMT+0000 (Coordinated Universal Time)

As developers, we are always on the lookout for tools and technologies that can improve our products and services. In this article, we will discuss the key differences between Tornado and FastAPI, two popular web frameworks for Python. Additionally, we will explain why we at Rеblаzе decided to switch from Tornado to FastAPI to enhance our offerings. Background: Tornado and FastAPI Tornado is an asynchronous networking library and web framework designed for handling long-lived connections and providing real-time updates in web applications. It has been around since 2009 and is well-established in the Python ecosystem.

View more...

Stream File Uploads to S3 Object Storage and Save Money

Aggregated on: Wed Apr 19 2023 13:30:17 GMT+0000 (Coordinated Universal Time)

This is the fourth post in a series all about uploading files for the web. In the previous posts, we covered uploading files using just HTML, uploading files using JavaScript, and how to receive file uploads on a Node.js server. Upload files with HTML Upload files with JavaScript Receive uploads in Node.js (Nuxt.js) Optimize storage costs with Object Storage Optimize performance with a CDN Secure uploads with malware scans This post is going to take a step back and explore architectural changes to reduce costs when adding file uploads to our applications.

View more...

Integration of Firebase Firestore With Redux Toolkit Query

Aggregated on: Wed Apr 19 2023 02:00:17 GMT+0000 (Coordinated Universal Time)

Integrating Firebase Firestore with Redux Toolkit Query is an efficient way to handle data management in modern web applications. Redux Toolkit Query is a library that helps to simplify the management of API data in a Redux store. Firebase Firestore, on the other hand, is a NoSQL document-oriented database that can store, retrieve and manage data. This technical article will explain how the above code integrates Firebase Firestore with Redux Toolkit Query to organize the code and the benefits of this approach. Benefits of Using Firebase Firestore With Redux Toolkit Query Using Firebase Firestore with Redux Toolkit Query provides several benefits. Here are three of them:

View more...

Your Scrum Team Is Shouting...

Aggregated on: Wed Apr 19 2023 00:00:17 GMT+0000 (Coordinated Universal Time)

We are all well aware that better interaction is essential to the success of any project. Along with adhering to Scrum Values, the expectation for Scrum teams is to have seamless communication and improved team collaboration. As a Scrum Master, I’ve worked with a variety of teams that have distinct dynamics. Some were extroverts, while others were introverts. Let me clarify that an introvert is not someone who never communicates or is always silent. An introvert is someone who prefers to be silent because of some reason.

View more...

Developer Experience: It’s Time To Start Complaining

Aggregated on: Tue Apr 18 2023 23:00:17 GMT+0000 (Coordinated Universal Time)

It's time to make noise. Developers need to take back their happiness and their productivity. But where should they start? On this week's episode of Dev Interrupted, we're joined by Justin Reock, Field CTO and Chief Evangelist at Gradle. With a mission to mitigate the toil, friction, and frustration felt by so many developers, Justin has become a tireless advocate of Developer Productivity Engineering. 

View more...

How We Built a 1% Website in 3 Days for €7

Aggregated on: Tue Apr 18 2023 23:00:17 GMT+0000 (Coordinated Universal Time)

Due to events outside of our control, Aria, Tage, and I were forced into a situation where we had to launch a successful and profitable ChatGPT-based website chatbot company in two weeks. The stakes are super high, but we'll get there with some help from our friends. Failure is not an option, though, so we're confident that we'll make it — especially considering all of our amazing friends who have been there for us these last days and supported us. Thank you, it means the world to us. The words "teamwork and friendship" have created meaning for us these last days in ways most people unfortunately never will experience during their lifetimes.

View more...