News Aggregator

Finding and Fixing Five Kinds of Architectural Technical Debt

Aggregated on: Thu Apr 13 2023 18:45:15 GMT+0000 (Coordinated Universal Time)

Developers, architects, and application teams are constantly chasing technical debt. For better or worse, it’s a nagging problem that too often gets kicked down the road until it’s too late and application development slows down, new features slip, test cycles increase, and costs ramp up. In the most public situations, the applications tip over completely — like we’ve seen most recently at Southwest Airlines, Twitter, FAA, and others which never get publicized — but you know who you are. Technical debt takes on various forms from source code smells to security risks to the more serious issue of architectural technical debt. Great tools exist to scan for source code quality and security, but tracking, baselining, and detecting architectural drift has been hard due to the lack of observability, tooling, and best practices. What exactly is architectural technical debt and why should I care? If you are an architect or developer responsible for maintaining and extending an older Java or .NET monolith, you probably are already deeply familiar with the problem. A monolithic application is actually defined by its architectural (monolithic) pattern which carries with it dense dependencies, long dependency chains, and in essence a big ball of mud that is opaque for any architect trying to understand and track. This is the essence of architectural technical debt: the class entanglements, deep dependencies, dead-code, long dependency chains, dense topologies, and lack of common code libraries that plague monoliths, older applications, and more recently even microservices that have begun to resemble monoliths themselves.

Software Quality Tutorial: Comprehensive Guide With Best Practices

Aggregated on: Thu Apr 13 2023 18:15:15 GMT+0000 (Coordinated Universal Time)

Software quality describes the characteristics of a software product that make it capable of meeting the needs of its users and stakeholders. Basically, it measures how well a piece of software performs the functions for which it was designed, as well as how well it complies with its requirements. The quality of a software product can play an important role in its success and users' satisfaction. According to a report, the economic impact of bad software quality in the US is approximately $2.08 trillion. It covers failed software projects, inadequate software quality in legacy systems, and operational software failures. Besides the monetary loss, bad software quality tarnishes the brand's reputation.

Bridging WebAssembly Gaps With Components and Wasifills

Aggregated on: Thu Apr 13 2023 18:15:15 GMT+0000 (Coordinated Universal Time)

An examination of how wasifills — a component adapter pattern like polyfills, but for components — can help bridge the gap between today's rapidly changing standards landscape and the future of interoperable components facilitated with wit and wit worlds. It's an amazing time to be on the bleeding edge of the WebAssembly adoption curve, but it's not without risk.

Stocks Notification: TradingView Webhook to Telegram

Aggregated on: Thu Apr 13 2023 18:15:15 GMT+0000 (Coordinated Universal Time)

At the start of the year, I worked on a Telegram bot that sends market data of certain stocks for the previous day's close to a Telegram channel. Features Basic info such as closing price, EMA20, difference between closing price and EMA20 Overextension from EMA20 based on the median delta when stock reverse in the next few days Example

The Art of Being Ready: Reliability in Extreme Conditions

Aggregated on: Thu Apr 13 2023 17:15:15 GMT+0000 (Coordinated Universal Time)

When it comes to online services, uptime is crucial, but it’s not the only thing to consider. Imagine running an online store — having your site available 99.9% of the time might sound good, but what if that 0.1% of downtime happens during the holiday shopping season? That could mean losing out on big sales. And what if most of your customers are only interested in a few popular items? If those pages aren’t available, it doesn’t matter that the rest of your site is working fine. Sometimes, being available during peak moments can make or break your business. It’s not just e-commerce — a small fraction of airports handle most of the air traffic, just a tiny minority of celebrities are household names, and only a handful of blockbuster movies dominate the box office each year. It’s the same distribution pattern everywhere.

Mobile Database Essentials

Aggregated on: Thu Apr 13 2023 16:00:15 GMT+0000 (Coordinated Universal Time)

Relational, NoSQL, cloud-based, embedded, multi-model — the database options are endless. When selecting the right database, it is important to explore essential components like local data storage, synchronization, security, and more. In this Refcard, assess critical data needs, storage requirements, and more when leveraging databases for cloud and edge applications.

.NET on AWS – Persisting Application Data to S3 (Part 2)

Aggregated on: Thu Apr 13 2023 16:00:15 GMT+0000 (Coordinated Universal Time)

In the previous post, we discussed AWS S3 service and its various use cases. We then set up an AWS S3 bucket with configurations and access for our web application data storage requirements. We created a .NET6 WebAPI project and some basic wiring/configuration to allow our application to access S3. However, we still have to write application code that will allow our user to store notes data (files) in an S3 bucket and read the information from these files as well for processing (CRUD operations). In this post, we will look into how to perform these operations from our .NET application code, along with the use of AWS SDK for S3.

Sandboxes in Kubernetes Using OpenTelemetry

Aggregated on: Thu Apr 13 2023 15:30:15 GMT+0000 (Coordinated Universal Time)

The OpenTelemetry project was announced in 2019 as the coming together of two efforts that existed prior to that — OpenTracing and OpenCensus, with the goal of becoming a single open standard for extracting telemetry from distributed microservice-based applications. The project is a collection of specifications, tools, and libraries intended to help collect telemetry from applications in the form of logs, metrics, and traces, which can then be forwarded to any observability tool that supports aggregating, visualizing, and introspecting this data. In this post, we will explore a new use-case that makes use of OpenTelemetry (abbreviated as OTel), specifically distributed context propagation that is enabled by OTel, in order to create lightweight environments called sandboxes that can then be used to enable various forms of microservice testing in a scalable fashion. We will also look at what kinds of applications this model works most naturally with and how it can help get high-quality testing feedback early in the development lifecycle.

Data Encryption Is the First Line of Defense Against Identity Theft and Cybercrime

Aggregated on: Thu Apr 13 2023 15:30:15 GMT+0000 (Coordinated Universal Time)

In recent times, cybersecurity has become an increasingly important issue. Last summer, a global study found that 82% of CIOs felt that their organizations were vulnerable to cyberattacks. This is because the number of cyber-attacks and identity thefts has increased worldwide. For example, there were over 236 million ransomware attacks in 2022, and 20% of Internet users were affected by hacked email servers. As such, it's more important than ever for individuals and businesses to ensure they're adequately protected against any malicious attack or data breach.

Migrating From Docker to Rancher Desktop: A Comprehensive Guide

Aggregated on: Thu Apr 13 2023 15:30:15 GMT+0000 (Coordinated Universal Time)

If you’re a developer, chances are you’ve worked with Docker at some point in your career. Docker has become the standard for containerization, allowing developers to package their applications in containers and deploy them anywhere. However, Docker isn’t the only containerization solution out there. Rancher Desktop is a popular alternative that offers many benefits over Docker. In this blog post, we’ll explore the reasons for migrating from Docker to Rancher Desktop, as well as the steps involved in the migration process. Why Migrate from Docker to Rancher Desktop? Before we dive into the migration process, let’s first explore the reasons why you might want to migrate from Docker to Rancher Desktop. Here are some of the key benefits of using Rancher Desktop:

AIPRM Plugin for ChatGPT

Aggregated on: Thu Apr 13 2023 14:45:15 GMT+0000 (Coordinated Universal Time)

Artificial Intelligence (AI) and Machine Learning (ML) are becoming increasingly popular in various fields, including natural language processing. One application of AI and ML in natural language processing is the development of automated chatbots. Chatbots are computer programs that can mimic human conversations. One of the most powerful tools used in developing chatbots is the AIPRM plugin. In this article, we will explore the AIPRM plugin for ChatGPT, its features, and how it is used in developing chatbots. What Is AIPRM Plugin? AIPRM is an acronym for Artificial Intelligence Powered Relationship Management. AIPRM Plugin is an advanced tool designed to enhance the performance of chatbots by leveraging machine learning algorithms. It is a plugin that can be integrated into chatbots to enhance their ability to understand and respond to human-like conversations. It is specifically designed for use with ChatGPT, a popular natural language processing model used in developing chatbots.

Don’t Risk It: Critical Cybersecurity Areas New Managers Must Not Overlook

Aggregated on: Thu Apr 13 2023 14:45:15 GMT+0000 (Coordinated Universal Time)

In today's business environment, company reorganizations are common. Reorganization can be difficult for managers, especially new ones, whether due to mergers and acquisitions, changes in business strategy, or economic factors. In today's fast-paced business world, reorganizations are becoming more common as companies try to stay competitive and adapt to changing market conditions. On the other hand, reorganizing a company can be difficult and present many problems that must be solved for a smooth transition. During a company reorganization, new managers must remember the importance of IT controls, the right way to transfer knowledge, and training. Common Pitfalls for New Managers While reorganization can bring about new opportunities and exciting changes, it can also bring about several pitfalls that new managers should be aware of. As a new manager, you must prepare for success by knowing what to do and avoid. Although there are numerous things you should solely focus on, you'll also want to avoid some common pitfalls.

Integrating Cloud-Based Applications, Kafka Middle-Ware/Data Streams, CRM, and Snowflake Data Warehouse in IT Architecture for Small and Medium Enterprises

Aggregated on: Thu Apr 13 2023 14:45:15 GMT+0000 (Coordinated Universal Time)

Small and medium-sized enterprises (SMEs) face unique challenges in their operations, especially when it comes to IT infrastructure. However, with the right technology stack, SMEs can streamline their operations, reduce costs, and achieve success in the ever-changing business landscape. In this blog post, we will explore how SMEs can use CRM, AWS, Kafka, and Snowflake data warehouse in their IT architecture to achieve the best solution with a scalable and advanced technology stack. Reference data steam system: Unlocking the Potential of IoT Applications.

Measuring and Tracking DevOps Performance With Metrics and KPIs

Aggregated on: Thu Apr 13 2023 13:45:14 GMT+0000 (Coordinated Universal Time)

With digital technologies transforming industries, companies adopt Agile and other practices to gain a competitive advantage. DevOps is one such method that has changed software development as we know it. The new-age approach helps accelerate productivity and also enables better collaboration between the development and operation teams. But the biggest benefit of adopting DevOps is faster time-to-market. It has helped around 83% of organizations unlock business value and deliver customer value faster. However, the brutal reality is that not all DevOps initiatives are successful.

Cybersecurity Learning Across Sectors: How ICCWS Brings Academics, Government, and Private Companies Together

Aggregated on: Thu Apr 13 2023 13:15:15 GMT+0000 (Coordinated Universal Time)

When you think of Baltimore, Maryland, you might immediately think of The Ravens, Edgar Allan Poe, or Old Bay Seasoning. Moving forward, I will always associate "BMore" (as the locals call it) with improved security across the public and private sectors, thanks to participating in the 18th International Conference on Cyber Warfare and Security, ICCWS, which happened March 9th and 10th, 2023, at Towson University, in the heart of Baltimore county.This unique event brings together academics, military professionals, government agencies, and professionals from all around the security world to discuss their research findings and the state of cybersecurity. All the sessions I attended were very informative, and I will be summarizing a few in this post, but the best part of this event was the lively hallway conversations and connections that were made. It is hard to imagine another event where Ph.D. candidates, developer advocates, and intelligence agency officers would get to share thoughts on the future of cyber threats while sharing a meal.While there were a lot of different subjects covered in the two days of sessions, there were some themes that popped up across multiple talks. Zero Trust Most everyone working in security and DevOps by now is familiar with the notion of Zero Trust, the approach that denies all access by default. We apply this in practice by implementing "the principle of least privilege," granting only enough access to let people and non-human entities get their work done and no more. In his talk "Can Zero Trust Restore Our Ailing Trust?" Justin Fanelli, Technical Director, Dept of Navy PEO Digital and Georgetown University, argues that for a lot of the industry, Zero Trust is just a buzzword at the moment, albeit the "Beatles of our current jargon."

Apollo Router Performance Monitoring with OpenTelemetry and Splunk APM

Aggregated on: Thu Apr 13 2023 13:15:15 GMT+0000 (Coordinated Universal Time)

The Apollo router is a powerful routing solution designed to replace the GraphQL Gateway. Built using Rust, it offers a high degree of flexibility, loose coupling, and exceptional performance. This self-hosted graph routing solution is highly configurable, making it an ideal choice for developers who require a high-performance routing system. With its ability to handle large amounts of traffic and complex data, the Apollo router is quickly becoming a popular choice among developers seeking a reliable and efficient routing solution. The binary implementation of the Apollo router comes equipped with a built-in telemetry plugin that functions as an OpenTelemetry collector agent. This plugin is responsible for sending traces and logs to the appropriate endpoints, making it an essential component of the performance monitoring process. By leveraging the capabilities of the telemetry plugin, developers can gain valuable insights into the performance of their applications, identify bottlenecks and optimize their system accordingly. With this integrated telemetry functionality, the Apollo router provides a streamlined and efficient performance monitoring solution.

Eight Reasons ChatGPT Is the Future of Conversational AI

Aggregated on: Thu Apr 13 2023 12:45:14 GMT+0000 (Coordinated Universal Time)

Utilizing Natural Language Processing and Deep Learning, ChatGPT is poised to revolutionize how we interact with Artificial Intelligence. With its ability to have meaningful conversations and comprehend intricate matters, this chatbot technology promises to become the new industry standard for conversational AI. Let's explore the eight reasons why ChatGPT is the future of Artificial Intelligence. From its innovative features to its seemingly unlimited potential, this groundbreaking AI is forging a path for the upcoming generation of chatbots. 1) ChatGPT Offers Lifelike Conversation ChatGPT is a revolutionary chatbot that is driven by natural language processing and machine learning technology. Designed to carry on lifelike conversations, it can effectively mimic human speech patterns and deliver immediate responses. Thanks to its training in millions of conversations, it can manage various conversation contexts. Moreover, it is distinguished from other chatbot technology due to its capability to learn from conversations, thereby providing meaningful answers to user queries.

How an Engineering Advisor Can Help You Grow Faster and Navigate Unfamiliar Terrain

Aggregated on: Wed Apr 12 2023 23:00:14 GMT+0000 (Coordinated Universal Time)

When you’re navigating new territory, it is essential to have a guide. And if you want to grow your skills as rapidly as possible, it helps to learn from someone who has done it before. Why Use an Engineering Advisor? An advisor is someone who helps you produce better results with your work. They:

How to Create a Microservice Architecture With Java

Aggregated on: Wed Apr 12 2023 20:30:14 GMT+0000 (Coordinated Universal Time)

Hey there! So, have you ever heard of Microservices Architecture? It's a modern approach to building software systems that are flexible, scalable, and easy to maintain. In this blog post, we're going to give you the lowdown on what Microservices Architecture is, its benefits, and how Java can be a great fit for building microservices. First things first, Microservices Architecture is an approach where a software system is broken down into smaller, independent services that communicate with each other through APIs. Each service is responsible for a specific business function and can be developed, deployed, and scaled independently. This makes it easier to maintain and modify the system, as changes made to one service don't affect the entire system.

The Ultimate API Development Guide: Strategy, Tools, Best Practices

Aggregated on: Wed Apr 12 2023 18:45:14 GMT+0000 (Coordinated Universal Time)

APIs play a prominent part in the mobile app development domain. Businesses are individually building their APIs to provide ease of effort to the developers and increase their customer base. For example, Google's map API is embedded in multiple third-party apps. Further, businesses are exploring new innovations through API development. With it, the start-up economy is gaining a boost using APIs from multiple tech giants. Hence, the importance to understand APIs in detail becomes necessary for technical and non-technical audiences. This blog will let you understand APIs in depth. You will learn how APIs work and how enterprises gain benefits through API development. Further, you will also learn what practices API development businesses must implement in their API teams, the tools and terminologies, and more

Simulating and Troubleshooting Thread Leak in Scala

Aggregated on: Wed Apr 12 2023 18:45:14 GMT+0000 (Coordinated Universal Time)

In this series of simulating and troubleshooting performance problems in Scala, let’s discuss how to simulate thread leaks. java.lang.OutOfMemoryError: unable to create new native thread will be thrown when more threads are created than the memory capacity of the device. When this error is thrown, it will disrupt the application’s availability. Video: To see the visual walk-through of this post, click below:

Automating the IBM MQ Upgrade on Redhat OpenShift Using BuildConfigs as CI/CD

Aggregated on: Wed Apr 12 2023 17:45:14 GMT+0000 (Coordinated Universal Time)

In this article, I will walk you through the IBM MQ upgrade automatically using buildconfigs following that uses Image stream to trigger the new build for upgrade IBM MQ on OpenShift Container Platform 4.x cluster setup on Linux. Further, I will be creating ImageStream, Dockerfile, BuidConfig and triggering the build to upgrade IBM MQ on OCP. Prerequisite Verify that your OpenShift cluster is up and running.

7 Tips for Mobile App Project Management

Aggregated on: Wed Apr 12 2023 17:45:14 GMT+0000 (Coordinated Universal Time)

[This article was written by Monique Rivers] It’s safe to say that mobile app development is just as complex a process as any other IT project. That’s why strategies used in projects aimed at developing mobile apps are to a large extent similar to those used by managers in other fields. Here are practical tips for making sure you pass the 7 following steps of app development smoothly and efficiently.

Must-Have Tool for Anonymous Virtual Livestreams

Aggregated on: Wed Apr 12 2023 17:15:14 GMT+0000 (Coordinated Universal Time)

Influencers have become increasingly important as more and more consumers choose to purchase items online — whether on Amazon, Taobao, or one of the many other prominent e-commerce platforms. Brands and merchants have spent a lot of money finding influencers to promote their products through live streams and consumer interactions, and many purchases are made on the recommendation of a trusted influencer. However, employing a public-facing influencer can be costly and risky. Many brands and merchants have opted instead to host live streams with their own virtual characters. This gives them more freedom to showcase their products and widens the pool of potential on-camera talent. For consumers, virtual characters can add fun and whimsy to the shopping experience.

How To Build for Payment Processing Resiliency

Aggregated on: Wed Apr 12 2023 17:15:14 GMT+0000 (Coordinated Universal Time)

If you're developing applications for a business, then one of your most important tasks is collecting payment for goods or services. Sure, providing those goods or services is essential to keeping customers happy. But if you don’t collect payments, your business won’t be around for very long. In the dev world, when we talk about infrastructure, we often consider the resiliency of our servers and APIs. We don’t talk about payment processing in the same way. But we should.

Relearning Java Thread Primitives

Aggregated on: Wed Apr 12 2023 17:15:14 GMT+0000 (Coordinated Universal Time)

I’ve coded in Java since the first beta. Even back then, threads were at the top of my list of favorite features. Java was the first language to introduce thread support in the language itself. It was a controversial decision back then. In the past decade, every language raced to include async/await, and even Java had some third-party support for that… But Java zigged instead of zagging and introduced the far superior virtual threads (project Loom). This post isn’t about that. I think it’s wonderful and proves the core power of Java. Not just as a language but as a culture. A culture of deliberating changes instead of rushing into the fashionable trend.

Using CockroachDB CDC With Apache Pulsar

Aggregated on: Wed Apr 12 2023 16:45:14 GMT+0000 (Coordinated Universal Time)

Previous Articles on CockroachDB CDC Using CockroachDB CDC with Azure Event Hubs Using CockroachDB CDC with Confluent Cloud Kafka and Schema Registry SaaS Galore: Integrating CockroachDB with Confluent Kafka, Fivetran, and Snowflake CockroachDB CDC using Minio as a cloud storage sink CockroachDB CDC using Hadoop Ozone S3 Gateway as a cloud storage sink Motivation Apache Pulsar is a cloud-native distributed messaging and streaming platform. In my customer conversations, it most often comes up when compared to Apache Kafka. I have a customer needing a Pulsar sink support as they rely on Pulsar's multi-region capabilities. CockroachDB does not have a native Pulsar sink; however, the Pulsar project supports Kafka on Pulsar protocol support, and that's the core of today's article. This tutorial assumes you have an enterprise license, you can also leverage our managed offerings where enterprise changefeeds are enabled by default. I am going to demonstrate the steps using a Docker environment instead.

How to Avoid Defect Leakages in Software Testing

Aggregated on: Wed Apr 12 2023 16:15:15 GMT+0000 (Coordinated Universal Time)

What Is a Defect Leakage? The basic answer is that it’s a malfunction that slipped past the whole squad and any test scripts in place, ending up in production and potentially affecting users. Defect Leakage is a metric used to determine the performance of QA testing, precisely how many defects are overlooked during QA testing.

Balancing Shift Left and Shift Right in Your DevOps Strategy

Aggregated on: Wed Apr 12 2023 15:45:14 GMT+0000 (Coordinated Universal Time)

Shift Left and Shift Right are two terms commonly used in the DevOps world to describe approaches for improving software quality and delivery. These approaches are based on the idea of identifying defects and issues as early as possible in the development process. This way, teams can address the issues quickly and efficiently, allowing software to meet user expectations. Shift Left focuses on early testing and defect prevention, while Shift Right emphasizes testing and monitoring in production environments. Here, in this blog, we will discuss the differences between these two approaches: Shift Left and Shift Right.

5 NAS Backup Strategies: Pros and Cons Explained

Aggregated on: Wed Apr 12 2023 14:45:14 GMT+0000 (Coordinated Universal Time)

A modern data-driven world makes organizations of different scales and sizes use NAS devices as their data storage extensively. The nature and use of that data may vary, but in most cases, organizations cannot afford to lose their NAS data assets under any circumstances. To keep control over data even after major disasters, an organization should implement a thorough NAS backup strategy. In this article, we explain the NAS backup definition, reasons to have a data protection strategy, and five main strategies to back up NAS devices. You'll be able to evaluate the pros and cons of every strategy yourself and pick the most suitable one for your infrastructure.

The Importance of Test-Driven Development in Software Development

Aggregated on: Wed Apr 12 2023 14:30:14 GMT+0000 (Coordinated Universal Time)

Software development has come a long way since the early days of programming. The importance of developing high-quality software has become increasingly important as businesses rely more heavily on technology to drive their operations. One method that has gained traction in recent years is Test-Driven Development (TDD). In this article, we'll explore what TDD is, why it's important, and how to implement it in your software development process. What Is Test-Driven Development? Test-Driven Development is a software development technique that emphasizes writing automated tests before writing the actual code. The process starts with writing a test case, then writing the code that satisfies that test case. Once the code has been written, the test is run to ensure that it passes. If the test fails, the code is revised until the test passes. This process is repeated until all the tests have passed and the software is considered complete.

Why Use Kubernetes for Your Enterprise?

Aggregated on: Wed Apr 12 2023 14:30:14 GMT+0000 (Coordinated Universal Time)

Why use Kubernetes? An important question every organization should ask. After the cloud and virtualization technologies disrupted infrastructure management in the first landscape, containerization is taking it to the next level. The advent of Docker popularized containerization. When containers run into hundreds and thousands, it becomes challenging for administrators to orchestrate container lifecycle tasks. This is where container orchestration tools come to the rescue. Kubernetes is a leader when it comes to container orchestration. This blog answers why using Kubernetes is essential for your enterprise and a quick introduction to Kubernetes Architecture.

The Power of Influence in Your Career as a Software Engineer [Video]

Aggregated on: Tue Apr 11 2023 20:15:14 GMT+0000 (Coordinated Universal Time)

As software engineers, we mainly talk about the power of tech skills and spending time learning new techniques. However, there is also the matter of influence that impacts your career as well. Why Should I Care About Influence? Usually, we only focus on the hard skill when discussing the software career path. That is a colossal mistake that several engineers, including me, have committed for a long time. In this post, I'll explain why influence is vital to your career.

How to Build a URL Shortener Web App With Flask Framework

Aggregated on: Tue Apr 11 2023 19:30:14 GMT+0000 (Coordinated Universal Time)

With the rapid growth in technology, URLs are generated to create a unique form of each URL by the URLs generator's APIs. People find it challenging to share long, comprehensive links with their friends or place them as a reference to their work. URL shorteners now reduce the lengths of each long URL to those short ones that can be understandable or mastered. In this article, we will learn how to build and run your link shortener on your machine for free using Flask framework and Python. What Is a URL Shortener? A URL shortener is a tool that takes a long, complex URL and generates a shortened, easier-to-recall version. The shortened URLs typically redirect to the original, longer URL when clicked. URL shorteners are commonly used for social media posts, email messages, and other situations where a long URL could be more convenient and easier to share.

Building an Optimized Data Pipeline on Azure Using Spark, Data Factory, Databricks, and Synapse Analytics

Aggregated on: Tue Apr 11 2023 18:30:14 GMT+0000 (Coordinated Universal Time)

Data processing in the cloud has become increasingly popular due to its scalability, flexibility, and cost-effectiveness. Modern tech stacks such as Apache Spark, Azure Data Factory, Azure Databricks, and Azure Synapse Analytics offer powerful tools for building optimized data pipelines that can efficiently ingest and process data on the cloud. This article will explore how these technologies can be used together to create an optimized data pipeline for data processing in the cloud. Ingesting Data With Azure Data Factory Azure Data Factory is a cloud-based data integration service enabling you to ingest data from various sources into a cloud-based data lake or warehouse. It provides built-in connectors for various data sources such as databases, file systems, cloud storage, and more. In addition, you can configure Data Factory to schedule and orchestrate data ingestion processes and define data flow transformations.

Johnston Harris: “QA Is the Wild West Today, and We Turn Cowboys Into Sheriffs”

Aggregated on: Tue Apr 11 2023 18:30:14 GMT+0000 (Coordinated Universal Time)

Johnston Harris is the CEO and Co-Founder of Appsurify, Inc., a software testing company that uses AI and Machine Learning to automate testing processes and improve software quality. Appsurify aims to help companies accelerate their development processes while reducing costs and improving overall product quality. We’ve discussed the risks and drawbacks of the bloated test suits, challenges faced by QA teams, the ways to minimize the rift between testers and developers, shift testing left, and relying on cutting-edge AI-powered tools and human creativity. Yes, human QA engineers are still in the game!

How To Find Broken Links Using Cypress [With Examples]

Aggregated on: Tue Apr 11 2023 18:00:14 GMT+0000 (Coordinated Universal Time)

Have you ever experienced a 404 error? From an end user’s perspective, a 404 error (or broken link) experience can be a complete turn-off. Apart from annoying end-user experience, broken links (or dead links) on a website can dampen the SEO (Search Engine Optimization) activity. The more 404 pages you have on your site, the fewer time users spend on the site. To reduce the bounce rate and build a top-notch online reputation for your website, it is essential to check for broken links using Cypress. It is relatively easy to check broken links on the website by performing Cypress testing compared to other test automation frameworks like Selenium.

.NET on AWS – Persisting Application Data to S3 (Part 1)

Aggregated on: Tue Apr 11 2023 17:30:14 GMT+0000 (Coordinated Universal Time)

Amazon S3 is the most commonly used managed storage solution in AWS. It provides object storage in a highly scalable and secure way. AWS guarantees 11 9s for its durability. Objects stored in S3 are shared access objects; shared meaning they can be accessed by different clients at the same time. S3 provides low latency for data, and it has high throughput (able to move data in and out of S3 quickly). S3 is highly available, durable, and can encrypt data. S3 provides access management, lifecycle management, and the ability to query-in-place (no need to move to a data lake). Static website hosting is another very popular feature of S3.

Lessons Learned From Picking a Java Driver for Amazon ElastiCache for Redis - Part 2

Aggregated on: Tue Apr 11 2023 16:45:14 GMT+0000 (Coordinated Universal Time)

In part one of this series, we looked at Jedis as the Java-based Redis driver when used in combination with ElastiCache for Redis in clustered mode. We learned that during a failover, Jedis takes some time to figure out what the new primary is before it can restore the connection to the ElastiCache cluster. In this post, I’ll share some of the lessons learned from switching to Lettuce as the driver for our Java-based application. A Different Driver Lettuce, a Java-based driver for Redis, is the default driver for Redis when working with Spring Framework. Lettuce is a fully non-blocking Redis client built with Netty providing Reactive, Asynchronous, and Synchronous Data Access.

Rolling Numbers Animation Using Only CALayers

Aggregated on: Tue Apr 11 2023 16:45:14 GMT+0000 (Coordinated Universal Time)

I’m an iOS Engineer at Triumph Labs, where I develop TriumphSDK for game devs. Not so long ago, I got a task to completely reimplement UI and animations. One of the most interesting parts was implementing of balance view with rolling animation of the number in it. At the first sight, it looks pretty simple, but we needed a well-configured custom solution. Of course, I checked existing libraries that I could reuse and adjust this kind of animation for our needs. After the first try, I figured out that the libraries are not so adjustable, and we cannot control the animation of each number. I won’t go into details too much. However, I decided to make my own solution from scratch.

Handling Bad Messages via DLQ by Configuring JDBC Kafka Sink Connector

Aggregated on: Tue Apr 11 2023 16:15:14 GMT+0000 (Coordinated Universal Time)

Any trustworthy data streaming pipeline needs to be able to identify and handle faults. Exceptionally while IoT devices ingest endlessly critical data/events into permanent persistence storage like RDBMS for future analysis via multi-node Apache Kafka cluster. (Please click here to read how to set up a multi-node Apache Kafka Cluster). There could be scenarios where IoT devices might send fault/bad events due to various reasons at the source points, and henceforth appropriate actions can be executed to correct it further. The Apache Kafka architecture does not include any filtering and error handling mechanism within the broker so that maximum performance/scale can be yielded. Instead, it is included in Kafka Connect, which is an integration framework of Apache Kafka. As a default behavior, if a problem arises as a result of consuming an invalid message, the Kafka Connect task terminates, and the same applies to JDBC Sink Connector. Kafka Connect has been classified into two categories, namely Source (to ingest data from various data generation sources and transport to the topic) and Sink (to consume data/messages from the topic and send them eventually to various destinations). Without implementing a strict filtering mechanism or exception handling, we can ingest/publishes messages inclusive of wrong formatted to the Kafka topic because the Kafka topic accepts all messages or records as byte arrays in key-value pairs. But by default, the Kafka Connect task stops if an error occurs because of consuming an invalid message, and on top of that JDBC sink connector additionally won’t work if there is an ambiguity in the message schema.

What Are Microservices Architecture and How Do They Work?

Aggregated on: Tue Apr 11 2023 16:15:14 GMT+0000 (Coordinated Universal Time)

In the era of mobile computing, app developers should be able to deploy actions quickly and make changes without redeploying the entire app. As a result, it has led to a new way of building software called "microservices." Microservices are small, self-contained parts of an app that each do their job and talk to each other through APIs. Even though these microservices are different, they work together to complete the job. Microservices are becoming an essential part of modern app architecture, so let's talk about what microservices architecture is, how they work, and why they are helpful.

Private DNS Zone With Azure HDInsight Kafka

Aggregated on: Tue Apr 11 2023 15:45:14 GMT+0000 (Coordinated Universal Time)

What Is HDInsight Kafka? Azure HDInsight Kafka is a cloud-based, managed Apache Kafka service offered by Microsoft Azure. Apache Kafka is an open-source, distributed streaming platform that allows for the processing and analyzing of high-volume, real-time data streams. Azure HDInsight Kafka provides a fully managed and scalable environment for deploying and running Apache Kafka clusters, allowing users to easily create, configure, and manage Kafka topics, producers, and consumers. It also provides integration with other Azure services, such as Azure Data Lake Storage, Azure Event Hubs, and Azure Stream Analytics, enabling users to ingest, process, and analyze large volumes of data in real-time.

Streaming in Mule 4: Processing Large Data Sets

Aggregated on: Tue Apr 11 2023 15:15:14 GMT+0000 (Coordinated Universal Time)

Mule is a lightweight enterprise service bus and integration framework provided by MuleSoft. The platform is Java-based and hence makes use of the JVM for process execution. It is the fundamental task in MuleSoft to integrate different systems, and there are scenarios where we take data from one system, then process it, and finally load it into another system (ETL), where these source and end systems can be Database, Salesforce, SFTP/FTP or Files. There can be various approaches we can adopt to achieve the above goal. But when processing a reasonable amount of data, one of the concerns designers and developers need to address is the potential of retrieving an enormous number of results in a single load session because if the size of the data being loaded into the JVM Heap Memory exceeds its size, we get the memory out of bound exception, ourapplication crashes, and the process execution fails. Some Conventional Solutions To address the problem we encountered in the above scenario, we can make use of the following logic:

Data Modernization Stages and Best Practices

Aggregated on: Tue Apr 11 2023 14:45:14 GMT+0000 (Coordinated Universal Time)

Data is a priceless resource for any company. But, the pace of innovation using data differs from organization to organization. Organizations with sprawling legacy systems slow down innovation, while cloud-native ones rapidly benefit from modern analytics and AI through more straightforward implementation. Companies with sizeable on-site data environments may plan to upgrade their data and use AI to overcome business obstacles. However, the transition from on-site to AI may seem intimidating to them.

Team Mentoring and Learning Path

Aggregated on: Tue Apr 11 2023 14:00:14 GMT+0000 (Coordinated Universal Time)

Considering a lot of demand for the various skill sets of people for upgrading existing systems or for new projects, it is very challenging to prepare the best team for the project. A few successful processes could improve the situation; I have listed some of them below and hope they are helpful.

5 Best Java Frameworks for Web Development in 2023

Aggregated on: Mon Apr 10 2023 22:45:14 GMT+0000 (Coordinated Universal Time)

Java is one of the most popular and widely used programming languages on earth. It is known for its reliability, performance, and compatibility across different platforms and devices. However, developing web applications with Java can be challenging and time-consuming without the help of frameworks. Frameworks are software libraries that provide a set of tools, features, and guidelines for building web applications. They simplify and speed up the development process by handling common tasks such as routing, data access, security, testing, and deployment. They also enable developers to follow best practices and write clean, maintainable, and reusable code.

API Governance: Best Practices and Strategies for Effective API Management

Aggregated on: Mon Apr 10 2023 22:45:14 GMT+0000 (Coordinated Universal Time)

API governance refers to the set of policies, procedures, and practices that organizations adopt to ensure the effective management and control of their Application Programming Interfaces (APIs). A well-designed API governance framework helps organizations to establish guidelines and best practices for developing, deploying, and managing APIs. It provides a structured approach to API development and helps ensure consistency in the APIs that are offered to internal and external stakeholders. Effective API governance also helps organizations to identify and mitigate risks associated with APIs, such as security vulnerabilities, compliance issues, and performance concerns. By implementing API governance best practices, organizations can optimize their API portfolio, improve collaboration across teams, and increase the value derived from their API investments. The diagram illustrates the various components that make up an API governance framework. At the center of the diagram is the API governance board, which is responsible for overseeing and managing the governance process. The board is made up of representatives from different business units and technology teams within the organization.

Cypress vs. Playwright: Which Is the Best Testing Tool?

Aggregated on: Mon Apr 10 2023 19:45:14 GMT+0000 (Coordinated Universal Time)

Are you having trouble deciding between Playwright and Cypress for cross-browser testing? The choice is challenging and dependent on the situation because each tool has specific benefits and drawbacks. This article will assist you in understanding the tools when you have to choose between Cypress Or Playwright.

The Holy Grail of Agile-DevOps Value Stream Hunting: Actualizing DevOps Transition Purpose

Aggregated on: Mon Apr 10 2023 18:30:14 GMT+0000 (Coordinated Universal Time)

Value streams have been a central tenet of Lean thinking for decades, starting with Toyota and the Lean Manufacturing movement, and are now widely adopted across industries. Despite this, many businesses still need to harness the full potential of value streams to drive organizational change and achieve greater efficiency and effectiveness. Instead, they may focus narrowly on metrics like team velocity or production pipeline speed, missing the broader picture of the end-to-end system. In modern product development, understanding value streams is crucial to optimizing our ways of working and delivering value to customers. By mapping the path to value, we can gain visibility into our processes and identify improvement areas, such as code deployment bottlenecks or mismatches between personnel and roles.