So far, in our CI/CD series, we’ve talked about some of the high-level concepts and terminology. In this installment, we’ll go into the practical phase of the build pipeline to show how it looks in implementation. We’ll go deeper into baking and frying to show how | Continue reading
The Apache Iceberg data lake storage format enables ACID transactions on tables saved to MinIO. ACID transactions enable multiple users and services to concurrently and reliably add and remove records atomically. At the same time, queries are isolated to maintain read consistency … | Continue reading
Observability is all about gathering information (traces, logs, metrics) with the goal of improving performance, reliability, and availability. Seldom it's just one of these that would pinpoint the root cause of an event, more often than not it's when we correlate this informatio … | Continue reading
The MinIO Batch Framework enables you to run batch operations directly on MinIO deployments. The first operation available is Batch Replication. | Continue reading
Continuity (replication) is a better path than recovery (backup). MinIO keeps your business up in the face of disaster. | Continue reading
Do you need to find a way to replace Hadoop in your data lake and add cloud native capabilities? | Continue reading
Have you ever wondered how the big dogs with hundreds of apps and millions of users manage their Continuous Integration (Builds) and Continuous Delivery (Deployments) workflows? | Continue reading
While Nutanix admitted violating MinIO's Apache v2 license it is still revoked. We ask that they remove all MinIO code from Nutanix Objects. | Continue reading
This post focuses on how Iceberg and MinIO complement each other and how various analytic frameworks (Spark, Flink, Trino, Dremio, and Snowflake) can leverage the two. | Continue reading
MinIO is the creator of MinIO Object Storage, an open source object storage platform. We strongly believe in keeping our software open source - the best quality software is made with community collaboration, so people are free to innovate and improve. Open source licenses are ess … | Continue reading
Enabling and tuning transparent data compression in MinIO. | Continue reading
Approximately 90% of all the data in the world is replicated data, with only 10% being genuine, new data. This has significant implications for an enterprise's data strategy — particularly when you consider the growth rates. For example, in 2020, the total amount of data generate … | Continue reading
Learn how to monitor and alert on metrics using Grafana Mimir and save data to MinIO for persistence. | Continue reading
Encrypting network traffic is low-hanging fruit when securing IT infrastructure. MinIO follows a pragmatic approach when it comes to TLS. It has to be secure, it has to be performant and it has to be simple. Things that matterIn almost all cases, there are just a couple of things … | Continue reading
Learn about anomaly detection and autoencoding with R, H2O and MinIO. | Continue reading
Snowflake is now the de facto standard for cloud data warehouse platforms. It is architected to support a variety of data tasks from pipelines, ETL, analytics and governance. Traditionally, all the data needed to be moved into Snowflake for an enterprise to take advantage of the … | Continue reading
With the advent of cloud computing, ephemeral compute instances have become ubiquitous. This introduces a whole set of challenges around managing the software, applying DevOps principles, addressing security vulnerabilities and ensuring automation. These are mission-critical in o … | Continue reading
With the introduction of Microsoft SQL Server 2022 now you can query and store data that is on MinIO. Using a feature called Polybase, this changes the game when it comes to the size and location of usable data. | Continue reading
LXD is a next generation system container and virtual machine manager for Linux systems from Canonical Ltd. LXD lets you manage your containers with a simple command line tool or via a REST API. LXMIN (lex-min) is a simple backup and restore tool for LXD instances (containers or … | Continue reading
Install and configure Loki, Promtail, Grafana and MinIO to quickly get started working with log data. | Continue reading
The talent crisis in the cloud isn't ending anytime soon. Your software selection process holds the key to your success. | Continue reading
Take advantage of MinIO’s performance, data protection and S3 API functionality for log management and analysis. | Continue reading
Primary storage is the storage your application talks to. In the cloud operating model that primarily object storage. Anyone who tells you differently is trying to sell you something. | Continue reading
MinIO is deprecating the gateway and will be completely removed in six months. This should not come as a surprise, we began informing the community in 2020 and have steadily removed unpopular gateways. In the last ten months, MinIO has only made bug fixes. The community can c … | Continue reading
Learn how to deploy MinIO in distributed mode to get S3 object storage on Azure. | Continue reading
While users take it for granted that infrastructure is available, you know that metrics, monitoring and alerting are critical to operations. | Continue reading
Working with a data lake of ZIP files? Learn how to download individual files from ZIP archives saved on MinIO. | Continue reading
Learn how to install and customize the world's fastest object storage on the world's largest public cloud. | Continue reading
Dig into MinIO internals and learn how this distributed object storage solution is optimized to handle thousands of versions of a single object. | Continue reading
Migrate data from HDFS to MinIO and enjoy the benefits of cloud-native architecture. | Continue reading
MinIO proves that anyone can be an object storage admin given the right GUI. | Continue reading
One-click automated performance testing for MinIO clusters. | Continue reading
Take advantage of cloud native, Kubernetes-oriented, microservices-based architectures with object storage. | Continue reading
Security is paramount at MinIO and sits up there with performance, simplicity and resilience in the pantheon of things that matter. MinIO encrypts data when stored on disk and when transmitted over the network. MinIO’s state-of-the-art encryption schemes support granular object- … | Continue reading
The multicloud is the new architectural standard. It includes multiple public clouds, private clouds, Kubernetes distros and the edge. Here is the playbook for success. | Continue reading
MinIO takes particular pride in the concept of manageability. This is born out of our relentless focus on simplicity. Our belief is that a single individual with moderate technical capability should be able to manage a multi-petabyte instance of MinIO in their free time. | Continue reading
The cloud is expanding - to the edge. Learn the rules, frameworks and attributes required to deliver successful storage in this critical topology component. | Continue reading
MinIO ups the ante with synchronous, multi-site, active-active replication. This technical post is a how to tutorial on this ultra-enterprise feature. | Continue reading
WARP performance testing MinIO on Supermicro Cloud DC servers with NVMe drives. | Continue reading
Streaming data is a core component of the modern object storage stack. Whether the source of that data is an edge device or an application running in the datacenter, streaming data is quickly outpacing traditional batch processing frameworks. Streaming data includes everything … | Continue reading
Modern architectures are combining database workloads with high-performance object storage. This is function of performance, throughput and scalability requirements. | Continue reading
Learn how to run Kubeflow on Azure Kubernetes Service with MinIO. | Continue reading
The future is multi-cloud and hybrid cloud. That represents a threat to mono-cloud players like AWS and an opportunity for multi-cloud players like MinIO. | Continue reading
Modern cloud applications have to continually produce growth - the question is how. The right question to ask may surprise you. The answer will make sense. | Continue reading
Scalability is not simply how big you can get on archival data - it is about how your system scales in the context of hybrid cloud storage architectures. | Continue reading
The hybrid cloud is the big cloud prize and architects need to consider a # of things as they design. Cloud native, software defined, scale, performance and consistency are a few. | Continue reading
Object storage as a service is the hottest concept in storage today and this post outlines how to quickly and easily enable it using MinIO and Kubernetes. | Continue reading