Word Alignment for Sentence Similarity

Semantic similarity increases with similar semantic units of similar semantic contexts in the monolingual word alignment. | Continue reading


@vaclavkosar.com | 2 years ago

Handle Exception and Close Resource Using Python Context Manager With-Statement

Wrap you resource creation and closure into context manager with-statement and catch exceptions there. | Continue reading


@vaclavkosar.com | 2 years ago

Cross-Attention Merges Images with Text in Transformer Architecture

Cross-attention is a way to merge two embedding sequences e.g. image with text. | Continue reading


@vaclavkosar.com | 2 years ago

SRU++ Model Speeds Up Transformer with Simple Recurrent Unit

Reducing compute by combining RNN with self-attention from Transformer architecture. | Continue reading


@vaclavkosar.com | 2 years ago

Manipulate Item Attributes via Disentangled Representation

Using attribute-specific subspaces for image manipulation retrieval, outfit completion, conditional similarity retrieval. | Continue reading


@vaclavkosar.com | 2 years ago

Electra – How to Train Bert 4x Cheaper

Reducing training flops 4x by GAN-like discriminative task compared to RoBERTa-500K | Continue reading


@vaclavkosar.com | 2 years ago

Expire-Span: Scaling Transformer by Forgetting

Reducing computational costs by differentiably dropping memorized embeddings from self-attention context. | Continue reading


@vaclavkosar.com | 2 years ago

Quilt Data Versioning Review and How-To

How to version data using Quilt data for Python on AWS S3. | Continue reading


@vaclavkosar.com | 2 years ago

Wav2vec Overview: Semi and Unsupervised Speech Recognition

Audio Word2vec - Quantize phonemes, transform, GAN the text. | Continue reading


@vaclavkosar.com | 2 years ago

DreamCoder: Wake and Sleep Program Learning

Learning to code by growing function library, fantasising coding tasks, and training neural search. | Continue reading


@vaclavkosar.com | 2 years ago

PID Controller: A Simple Control Loop Mechanism

Proportional–integral–derivative controller calculates feedback to reduce the error in the next step. | Continue reading


@vaclavkosar.com | 2 years ago

Submodularity in Ranking, Summarization, and Self-Attention

Diminishing returns with a budget constraint in problems of coverage and results diversification. | Continue reading


@vaclavkosar.com | 3 years ago

Brutalism and Modernism Collide at Sunshine Plaza in Prague

Take a tour of the surprising merge of a modern and soviet era design on a Prague’s public square with this photo album. | Continue reading


@vaclavkosar.com | 3 years ago

How to Improve Acoustics with Stealthy Acoustic Wall Panels

To improve your apartment acoustics while not making it too ugly, place cheap thin acoustic wall panels behind an art, such as wall-mounted world map. | Continue reading


@vaclavkosar.com | 3 years ago

BentoML vs. Cortex for ML model serving

To serve ML models, this post compares major open source platforms BentoML and Cortex. | Continue reading


@vaclavkosar.com | 3 years ago

Stealthy acoustic panel – The acoustic world map

Continue reading


@vaclavkosar.com | 4 years ago

Learn text faster with a generated quiz

Continue reading


@vaclavkosar.com | 4 years ago

Thinkpad P53 vs. P52 Thermals: No Improvement

Continue reading


@vaclavkosar.com | 4 years ago

Highly Compressed Richard Hamming's Lectures

Continue reading


@vaclavkosar.com | 4 years ago

Debounce in Bash

Continue reading


@vaclavkosar.com | 5 years ago

GDPR Is Copyright

Continue reading


@vaclavkosar.com | 5 years ago