Allgemein
Feature-wise transformations
A simple and surprisingly effective family of conditioning mechanisms.
Weiterlesen
How to List Users in Linux
Have you ever wanted to list all users in your Linux system or to count the number of users in the system? There are commands to...
WeiterlesenHow to Install Go on CentOS 7
In this tutorial we will show you how to download and install Go on CentOS 7. Go is a modern open-source programming language created by Google.
WeiterlesenHow to List Installed Packages on Ubuntu
In this tutorial we will show you how to list and filter installed packages on Ubuntu. We will also show you how to check whether a...
WeiterlesenHow to Install Git on Ubuntu 18.04
This tutorial will guide you through the steps required to install Git on Ubuntu 18.04. Git is a de-facto standard for a distributed version control system...
WeiterlesenRsync Command in Linux with Examples
rsync is a fast and versatile command-line utility for synchronizing files and directories between two locations over a remote shell, or from/to a remote Rsync daemon.
WeiterlesenHow to Change Hostname on CentOS 7
This tutorial guides you through the process of changing a hostname on a CentOS 7 without the need of restarting your system.
WeiterlesenLinux Shutdown Command
In this tutorial, we will show you how to use the shutdown command through practical examples and detailed explanations of the most common shutdown options. The...
WeiterlesenHow to Install PHP on Ubuntu 18.04
In this tutorial we will cover the steps necessary to install the distro’s default PHP 7.2 on Ubuntu 18.04. We’ll also show you how to install...
WeiterlesenHow to Install VirtualBox on Ubuntu 18.04
In this tutorial we’ll show you how to install VirtualBox on an Ubuntu 18.04 machine. VirtualBox is an open-source cross-platform virtualization software which allows you to...
WeiterlesenHow to Install Node.js and npm on Debian 9
In this tutorial, we will cover how to install Node.js and npm on a Debian 9 system. Node.js is an open-source cross-platform JavaScript run-time environment built...
WeiterlesenHow to Check your Ubuntu Version
In this tutorial, we’ll show you how to find your Ubuntu version using the command line or from within the graphical interface.
WeiterlesenHow to Change User Password in Linux
In this guide we’ll explain how to change a user password in Linux. The instructions should work on any Linux distribution, including Ubuntu, Debian, and CentOS.
WeiterlesenHow to Install Plex Media Server on Ubuntu 18.04
In this tutorial we’ll walk you through installing Plex Media Server on Ubuntu 18.04. Plex is a streaming media server that lets you organize your video,...
WeiterlesenHow to Install Apache on Ubuntu 18.04
This tutorial explains how to install and manage the Apache web server on Ubuntu 18.04. Apache HTTP server is the most popular web server in the...
WeiterlesenAttention? Attention!
[Updated on 2018-10-28: Add Pointer Network and the link to my implementation of Transformer.] [Updated on 2018-11-06: Add a link to the implementation of Transformer model.]...
WeiterlesenHow To Create a Sudo User on Debian
The sudo command (short for Super-user do) is a program designed to allow users to execute commands with the security privileges of another user, by default...
WeiterlesenHow to Install Pip on Debian 9
This tutorial will walk you through installing Python Pip on Debian 9 and teach you how to install and manage Python packages with pip. Pip is...
WeiterlesenHow to Install MySQL on Ubuntu 18.04
MySQL is the most popular open-source relational database management system. In this tutorial we will show you how to install and secure MySQL on an Ubuntu...
WeiterlesenWget Command in Linux with Examples
GNU Wget is a command-line utility for downloading files from the web.
WeiterlesenHow to Install and Use Docker on Ubuntu 18.04
Docker is a containerization technology that allows you to quickly build, test and deploy applications as portable, self-sufficient containers that can run virtually anywhere. In this...
WeiterlesenHow to Back Up and Restore MySQL Databases with Mysqldump
This tutorial explains how to backup and restore MySQL or MariaDB databases from the command line using the mysqldump utility. The backup files created by the...
WeiterlesenHow to Setup Passwordless SSH Login
In this article we will show you how to setup an SSH key-based authentication and connect to your Linux servers without a entering password.
WeiterlesenHow to Deploy Rocket.Chat on Ubuntu 18.04
Rocket.Chat is an open-source team communication platform, a self-hosted Slack alternative. Rocket.Chat is a perfect solution for companies and communities that want to host their own...
WeiterlesenFind Command in Linux (Find Files and Directories)
The find command searches for files and directories based on a user given expression.
WeiterlesenHow To Use Linux Screen
Screen or GNU Screen, is a terminal multiplexer. In other words, it means that you can a start a screen session and then open any number...
WeiterlesenHow to Install Go on Ubuntu 18.04
Go is a modern open-source programming language created by Google. This tutorial will guide you through the steps of downloading and installing Go on an Ubuntu...
WeiterlesenHow to Install and Configure GitLab on Ubuntu 18.04
This tutorial covers the steps necessary for installing and configuring GitLab on an Ubuntu 18.04 system. GitLab is a web-based open-source Git repository manager written in...
WeiterlesenHow to Install Tomcat 8.5 on Debian 9
This tutorial will show you how to install Apache Tomcat 8.5 on Debian 9 and configure the Tomcat web management interface. Tomcat is one of the...
WeiterlesenHow to Change Hostname on Ubuntu 18.04
This tutorial will guide you through the process of changing a hostname on Ubuntu 18.04 without the need of restarting your system.
WeiterlesenHow to Set Up a Firewall with UFW on Ubuntu 18.04
By default, Ubuntu comes with a firewall configuration tool called UFW (Uncomplicated Firewall). UFW is a user-friendly front-end for managing iptables firewall rules.
WeiterlesenHow to Install Python 3 on CentOS 7
This tutorial will guide you through installing Python 3 on a CentOS 7 system using the Software Collections (SCL) along side the distribution default Python version...
WeiterlesenHow to Install Pip on CentOS 7
In this tutorial we will walk through how to install Python Pip on CentOS 7 and cover the basics of how to install and manage Python...
WeiterlesenInstall MySQL on CentOS 7
With the release of CentOS 7 MySQL, the world’s most popular open-source relational database management system is no longer available in the CentOS’s repositories and MariaDB...
WeiterlesenHow to Install Drupal on Ubuntu 18.04
In this tutorial we will show you how to install Drupal 8.6 on an Ubuntu 18.04 machine. There are multiple ways to install Drupal, this tutorial...
WeiterlesenHow to Manage MySQL Databases and Users from the Command Line
MySQL is the most popular open-source relational database management system. This tutorial explains how to use the command line to create and manage MySQL and MariaDB...
WeiterlesenHow to Install Node.js and npm on Ubuntu 18.04
Node.js is an open-source cross-platform JavaScript run-time environment that allows server-side execution of JavaScript code. In this tutorial, we will show you several different ways of...
WeiterlesenHow to Install Pip on Ubuntu 18.04
In this tutorial, we will show you how to install Python Pip on Ubuntu 18.04 and go through the basics of how to install and manage...
WeiterlesenHow to Install and Use Docker on CentOS 7
In this tutorial, we’ll go through how to install Docker CE on CentOS 7 and explore the basic Docker concepts and commands.
WeiterlesenHow to Install Node.js and npm on CentOS 7
This tutorial walks you through the steps to install Node.js and npm on a CentOS 7 machine. Node.js is a cross-platform JavaScript run-time environment that allows...
WeiterlesenHow To Create a Sudo User on Ubuntu
In this guide we will show you how to create a new user on an Ubuntu machine and give it sudo access. You can then use...
WeiterlesenHow to Install Tomcat 8.5 on Ubuntu 18.04
This tutorial demonstrates how to install Tomcat 8.5 on Ubuntu 18.04. Tomcat is one of the most widely adopted applications and web servers in the world...
WeiterlesenImplementing Deep Reinforcement Learning Models with Tensorflow + OpenAI Gym
The full implementation is available in lilianweng/deep-reinforcement-learning-gym In the previous two posts, I have introduced the algorithms of many deep reinforcement learning models. Now it is...
Weiterlesen
Announcing Stack Overflow for Teams
Hey, we have a new thing for you today! Today’s new thing is called Stack Overflow for Teams. It lets you set up a private place...
WeiterlesenHow to deploy Odoo 11 on Ubuntu 18.04
This guide covers the steps necessary for installing and configuring Odoo for production using Git source and Python virtual environment on an Ubuntu 18.04 system.
WeiterlesenHow to Install Java on Ubuntu 18.04
This tutorial describes how to install OpenJDK as well as Oracle Java on Ubuntu 18.04. Java is one of the most popular programming languages in the...
WeiterlesenSecure Nginx with Let’s Encrypt on Ubuntu 18.04
Let’s Encrypt is a free and open certificate authority developed by the Internet Security Research Group. In this tutorial, we’ll provide a step by step instructions...
WeiterlesenHow To Set Up Nginx Server Blocks on Ubuntu 18.04
Nginx Server Blocks allows you to run more than one website on a single machine. With Server Blocks, you can specify the site document root (the...
WeiterlesenHow to Install Nginx on Ubuntu 18.04
This tutorial will outline the steps to install and manage Nginx on your Ubuntu 18.04 machine. Nginx is a free, open-source, high-performance HTTP and reverse proxy...
WeiterlesenHow to Upgrade from Ubuntu 16.04 to 18.04
The latest Ubuntu LTS release, Ubuntu 18.04 (Bionic Beaver), was released on April 26, 2018 and it will be supported for 5 years until April 2023....
WeiterlesenHow to Install Apache on CentOS 7
Apache HTTP server is the most popular web server in the world. The following instructions describe how to install and manage the Apache web server on...
Weiterlesen
Strange and maddening rules
There’s this popular idea among developers that when you face a problem with code, you should get out a rubber duck and explain, to the duck,...
WeiterlesenHow to deploy Mattermost on CentOS 7
Mattermost brings all your team communication into one place and provides various features including file sharing, one-on-one and group messaging, custom emojis, video calls and more.
WeiterlesenHow to Install Java on Debian 9
In this tutorial, we will walk through installing Java on Debian 9. Java is one of the most popular programming languages used to build different kinds...
WeiterlesenHow to Setup Automatic Odoo Backup
In this tutorial we will walk you through the process of creating automatic daily backups of your Odoo databases. Odoo is the most popular open-source ERP...
Weiterlesen
A Dusting of Gamification
[This is the second in a series of posts about Stack Overflow. The first one is The Stack Overflow Age.] Around 2010 the success of Stack...
WeiterlesenHow to deploy Rocket.Chat on CentOS 7
In this tutorial, we will show you how to install and deploy Rocket.Chat on a CentOS 7 server with Nginx as a SSL reverse proxy. Rocket.Chat...
WeiterlesenPolicy Gradient Algorithms
[Updated on 2018-06-30: add two new policy gradient methods, SAC and D4PG.] [Updated on 2018-09-30: add a new policy gradient method, TD3.] [Updated on 2019-02-09: add...
WeiterlesenHow To Create a Sudo User on CentOS
The sudo command is designed to allow users to run programs with the security privileges of another user, by default the root user. In this guide...
WeiterlesenHow to Reset the MySQL Root Password
Have you forgotten your MySQL root password? Don’t worry, it happens to all of us. In this post we will show you how to reset the...
WeiterlesenCreate a Linux Swap File
Swap is a space on a disk that is used when the amount of physical RAM memory is full. When a Linux system runs out of...
WeiterlesenHow to Install Tomcat 8.5 on CentOS 7
This tutorial shows you how to install Tomcat 8.5 on CentOS 7. Tomcat is an open-source implementation of the Java Servlet, JavaServer Pages, Java Expression Language...
WeiterlesenInstall Odoo 11 on CentOS 7
Odoo is one of the most popular Open Source ERP Business softwares in the world. This guide covers the steps necessary for installing and configuring Odoo...
WeiterlesenFsyncgate: errors on fsync are unrecovarable
This is an archive of the original “fsyncgate” email thread. This is posted here because I wanted to have a link that would fit on a...
WeiterlesenConfigure Magento 2 to use Varnish on CentOS 7
The page speed is crucial to the success of your online store. This tutorial covers the steps involved in configuring Magento 2 to use Varnish as...
WeiterlesenHow to Install Java on CentOS 7
This tutorial shows you how to install Java on CentOS 7. Java is one of the most popular programming languages used to build different kinds of...
WeiterlesenInstall Magento 2 on CentOS 7
Magento is an e-commerce platform built on open-source technology combining powerful features with flexibility and user friendly interface. In this tutorial, we will walk you through...
WeiterlesenInstall PHP 7 on CentOS 7
CentOS 7 ships with PHP version 5.4 which has been officially EOL for quite some time and is no longer supported. In this guide we will...
WeiterlesenInstall MariaDB on CentOS 7
MariaDB is an open-source relational database management system, backward compatible, binary drop-in replacement of MySQL. In this tutorial we will show you how to install the...
WeiterlesenSecure Nginx with Let’s Encrypt on CentOS 7
In this tutorial, we’ll provide a step by step instructions about how to secure your Nginx with Let’s Encrypt using the certbot tool on CentOS 7
WeiterlesenHow to Install Nginx on CentOS 7
Nginx pronounced ‘engine x’ is a free, open-source, high-performance HTTP and reverse proxy server responsible for handling the load of some of the largest sites on...
WeiterlesenInstall and Configure Roundcube Webmail
Roundcube is a web-based IMAP email client with a very intuitive and modern user interface written in PHP. This tutorial covers the necessary steps to install...
WeiterlesenInstall and Integrate Rspamd
In this tutorial we will go through the installation and configuration of the Rspamd spam filtering system and its integration into our mail server and creating...
WeiterlesenThe Building Blocks of Interpretability
Interpretability techniques are normally studied in isolation. We explore the powerful interfaces that arise when you combine them — and the rich structure of this combinatorial...
WeiterlesenInstall and configure Postfix and Dovecot
Postfix is an open-source mail transfer agent (MTA), a service used to send and receive emails. Dovecot is an IMAP/POP3 server and in our setup it...
WeiterlesenSet up a mail server with PostfixAdmin
Postfix Admin is a web based interface which allows users to configure and manage a Postfix based email server. With Postfix Admin you can create and...
WeiterlesenA (Long) Peek into Reinforcement Learning
[Updated on 2020-09-03: Updated the algorithm of SARSA and Q-learning so that the difference is more pronounced. [Updated on 2021-09-19: Thanks to 爱吃猫的鱼, we have this...
WeiterlesenThe Multi-Armed Bandit Problem and Its Solutions
The algorithms are implemented for Bernoulli bandit in lilianweng/multi-armed-bandit. Exploitation vs Exploration The exploration vs exploitation dilemma exists in many aspects of our life. Say, your...
WeiterlesenConfigure Odoo with Nginx as a Reverse Proxy
Odoo comes with a built-in web server, but in most cases it is recommended to have a reverse proxy in front of it which will act...
Weiterlesen(started posting on Medium instead)
The current state of this blog (with the last post 2 years ago) makes it look like I’ve disappeared. I’ve certainly become less active on blogs...
WeiterlesenHow to Install Nginx on Ubuntu 16.04
In this tutorial, we’ll discuss how to install and manage Nginx on Ubuntu 16.04 systems. Nginx pronounced engine x is a free, open-source, high-performance HTTP and...
Weiterlesen
To Serve Man, with Software
I didn’t choose to be a programmer. Somehow, it seemed, the computers chose me. For a long time, that was fine, that was enough; that was all...
WeiterlesenObject Detection for Dummies Part 3: R-CNN Family
[Updated on 2018-12-20: Remove YOLO here. Part 4 will cover multiple fast object detection algorithms, including YOLO.] [Updated on 2018-12-27: Add bbox regression and tricks sections...
WeiterlesenSecure Nginx with Let’s Encrypt on Ubuntu 16.04
In this tutorial, we’ll provide a step by step instructions about how to secure your Nginx with Let’s Encrypt using the certbot tool on Ubuntu 16.04
WeiterlesenComputer latency: 1977-2017
I’ve had this nagging feeling that the computers I use today feel slower than the computers I used as a kid. As a rule, I don’t...
WeiterlesenHow to Install Odoo 11 on Ubuntu 16.04
Odoo is one of the most popular business softwares in the world. This guide covers the steps necessary for installing and configuring Odoo using Git source...
WeiterlesenObject Detection for Dummies Part 2: CNN, DPM and Overfeat
Part 1 of the “Object Detection for Dummies” series introduced: (1) the concept of image gradient vector and how HOG algorithm summarizes the information across all...
WeiterlesenUsing Artificial Intelligence to Augment Human Intelligence
By creating user interfaces which let us work with the representations inside machine learning models, we can give people new tools for reasoning.
WeiterlesenSequence Modeling with CTC
A visual guide to Connectionist Temporal Classification, an algorithm used to train deep neural networks in speech recognition, handwriting recognition and other sequence problems.
WeiterlesenHow good are decisions? Evaluating decision quality in domains where evaluation is easy
A statement I commonly hear in tech-utopian circles is that some seeming inefficiency can’t actually be inefficient because the market is efficient and inefficiencies will quickly...
Weiterlesen
How out of date are Android devices?
It’s common knowledge that Android device tend to be more out of date than iOS devices, but what does this actually mean? Let’s look at android...
WeiterlesenUI backwards compatibility
About once a month, an app that I regularly use will change its UI in a way that breaks muscle memory, basically tricking the user into...
WeiterlesenObject Detection for Dummies Part 1: Gradient Vector, HOG, and SS
I’ve never worked in the field of computer vision and has no idea how the magic could work when an autonomous car is configured to tell...
WeiterlesenFilesystem error handling
We’re going to reproduce some results from papers on filesystem robustness that were written up roughly a decade ago: Prabhakaran et al. SOSP 05 paper, which...
WeiterlesenKeyboard latency
If you look at “gaming” keyboards, a lot of them sell for $100 or more on the promise that they’re fast. Ad copy that you’ll see...
WeiterlesenLearning Word Embedding
Human vocabulary comes in free text. In order to make a machine learning model understand and process the natural language, we need to transform the free-text...
WeiterlesenAnatomize Deep Learning with Information Theory
Professor Naftali Tishby passed away in 2021. Hope the post can introduce his cool idea of information bottleneck to more people. Recently I watched the talk...
Weiterlesen
Branch prediction
This is a pseudo-transcript for a talk on branch prediction given at Two Sigma on 8/22/2017 to kick off “localhost”, a talk series organized by RC....
WeiterlesenFrom GAN to WGAN
[Updated on 2018-09-30: thanks to Yoonju, we have this post translated in Korean!] [Updated on 2019-04-18: this post is also available on arXiv.] Generative adversarial network...
WeiterlesenSattolo’s algorithm
I recently had a problem where part of the solution was to do a series of pointer accesses that would walk around a chunk of memory...
WeiterlesenHow to Explain the Prediction of a Machine Learning Model?
The machine learning models have started penetrating into critical areas like health care, justice systems, and financial industry. Thus to figure out how the models make...
WeiterlesenPredict Stock Prices Using RNN: Part 2
In the Part 2 tutorial, I would like to continue the topic on stock price prediction and to endow the recurrent neural network that I have...
Weiterlesen
Terminal latency
There’s a great MSR demo from 2012 that shows the effect of latency on the experience of using a tablet. If you don’t want to watch...
WeiterlesenPredict Stock Prices Using RNN: Part 1
This is a tutorial for how to build a recurrent neural network using Tensorflow to predict stock market prices. The full working code is available in...
WeiterlesenAn Overview of Deep Learning for Curious People
(The post was originated from my talk for WiMLDS x Fintech meetup hosted by Affirm.) I believe many of you have watched or heard of the...
WeiterlesenThe widely cited studies on mouse vs. keyboard efficiency are completely bogus
Which is faster, keyboard or mouse? A large number of programmers believe that the keyboard is faster for all (programming-related) tasks. However, there are a few...
WeiterlesenStartup options v. cash
I often talk to startups that claim that their compensation package has a higher expected value than the equivalent package at a place like Facebook, Google,...
WeiterlesenWhy Momentum Really Works
We often think of optimization with momentum as a ball rolling down a hill. This isn’t wrong, but there is much more to the story.
WeiterlesenResearch Debt
Science is a human activity. When we fail to distill and explain research, we accumulate a kind of debt…
WeiterlesenContact Linuxize
Need to contact Linuxize? This is the place. There are a bunch of ways to reach us, so pick the one that works best for you.
WeiterlesenHow web bloat impacts users with slow connections
A couple years ago, I took a road trip from Wisconsin to Washington and mostly stayed in rural hotels on the way. I expected the internet...
WeiterlesenExperiments in Handwriting with a Neural Network
Several interactive visualizations of a generative model of handwriting. Some are fun, some are serious.
WeiterlesenHN: the good parts
HN comments are terrible. On any topic I’m informed about, the vast majority of comments are pretty clearly wrong. Most of the time, there are zero...
WeiterlesenDeconvolution and Checkerboard Artifacts
When we look very closely at images generated by neural networks, we often see a strange checkerboard pattern of artifacts.
WeiterlesenProgramming book recommendations and anti-recommendations
There are a lot of “12 CS books every programmer must read” lists floating around out there. That’s nonsense. The field is too broad for almost...
WeiterlesenHow to Use t-SNE Effectively
Although extremely useful for visualizing high-dimensional data, t-SNE plots can sometimes be mysterious or misleading.
WeiterlesenHiring and the market for lemons
Joel Spolsky has a classic blog post on “Finding Great Developers” where he popularized the meme that great developers are impossible to find, a corollary of...
WeiterlesenI could do that in a weekend!
I can’t think of a single large software company that doesn’t regularly draw internet comments of the form “What do all the employees do? I could...
Weiterlesen
Is dev compensation bimodal?
Developer compensation has skyrocketed since the demise of the Google et al. wage-suppressing no-hire agreement, to the point where compensation rivals and maybe even exceeds compensation...
WeiterlesenHow I learned to program
Tavish Armstrong has a great document where he describes how and when he learned the programming skills he has. I like this idea because I’ve found...
WeiterlesenAttention and Augmented Recurrent Neural Networks
A visual overview of neural attention, and the powerful extensions of neural networks being built on top of it.
Weiterlesen
A Survival Guide to a PhD
This guide is patterned after my “Doing well in your courses”, a post I wrote a long time ago on some of the tips/tricks I’ve developed...
Weiterlesen
Notes on concurrency bugs
Do concurrency bugs matter? From the literature, we know that most reported bugs in distributed systems have really simple causes and can be caught by trivial...
Weiterlesen
Deep Reinforcement Learning: Pong from Pixels
<!– –> This is a long overdue blog post on Reinforcement Learning (RL). RL is hot! You may have noticed that computers can now automatically learn...
WeiterlesenSome programming blogs to consider reading
This is one of those “N technical things every programmer must read” lists, except that “programmer” is way too broad a term and the styles of...
WeiterlesenGoogle SRE book
The book starts with a story about a time Margaret Hamilton brought her young daughter with her to NASA, back in the days of the Apollo...
WeiterlesenWe only hire the trendiest
An acquaintance of mine, let’s call him Mike, is looking for work after getting laid off from a contract role at Microsoft, which has happened to...
Weiterlesen
su3su2u1 physics tumblr archive
These are archived from the now defunct su3su2u1 tumblr. A Roundabout Approach to Quantum Mechanics This will be the first post in what I hope will...
Weiterlesen
Harry Potter and the Methods of Rationality review by su3su2u1
These are archived from the now defunct su3su2u1 tumblr. Since there was some controversy over su3su2u1’s identity, I’ll note that I am not su3su2u1 and that...
Weiterlesen
Sampling v. tracing
Perf is probably the most widely used general purpose performance debugging tool on Linux. There are multiple contenders for the #2 spot, and, like perf, they’re...
WeiterlesenWe saw some really bad Intel CPU bugs in 2015 and we should expect to see more in the future
2015 was a pretty good year for Intel. Their quarterly earnings reports exceeded expectations every quarter. They continue to be the only game in town for...
WeiterlesenNormalization of deviance
Have you ever mentioned something that seems totally normal to you only to be greeted by surprise? Happens to me all the time when I describe...
WeiterlesenBig companies v. startups
There’s a meme that’s been going around for a while now: you should join a startup because the money is better and the work is more...
Weiterlesen
Files are hard
I haven’t used a desktop email client in years. None of them could handle the volume of email I get without at least occasionally corrupting my...
Weiterlesen
Why use ECC?
Jeff Atwood, perhaps the most widely read programming blogger, has a post that makes a case against using ECC memory. My read is that his major...
WeiterlesenWhat’s worked in Computer Science: 1999 v. 2015
In 1999, Butler Lampson gave a talk about the past and future of “computer systems research”. Here are his opinions from 1999 on “what worked”. Yes...
Weiterlesen
Short Story on AI: A Cognitive Discontinuity.
The idea of writing a collection of short stories has been on my mind for a while. This post is my first ever half-serious attempt at...
Weiterlesen
Infinite disk
Hardware performance “obviously” affects software performance and affects how software is optimized. For example, the fact that caches are multiple orders of magnitude faster than RAM...
Weiterlesen
What a Deep Neural Network thinks about your #selfie
Convolutional Neural Networks are great: they recognize things, places and people in your personal photos, signs, people and lights in self-driving cars, crops, forests and traffic...
Weiterlesen
Why Intel added cache partitioning
Typical server utilization is between 10% and 50%. Google has demonstrated 90% utilization without impacting latency SLAs. Xkcd estimated that Google owns 2 million machines. If...
Weiterlesen
Slowlock
Every once in awhile, you hear a story like “there was a case of a 1-Gbps NIC card on a machine that suddenly was transmitting only...
WeiterlesenNeural Networks, Types, and Functional Programming
Deep learning, despite its remarkable successes, is a young field – perhaps ten years old. While models called artificial neural networks have been studied for decades,...
WeiterlesenVisual Information Theory
I love the feeling of having a new way to think about the world. I especially love when there’s some vague idea that gets formalized into...
WeiterlesenCalculus on Computational Graphs: Backpropagation
Backpropagation is the key algorithm that makes training deep models computationally tractable. For modern neural networks, it can make training with gradient descent as much as...
Weiterlesen
Steve Yegge’s prediction record
I try to avoid making predictions1. It’s a no-win proposition: if you’re right, hindsight bias makes it look like you’re pointing out the obvious. And most...
WeiterlesenUnderstanding LSTM Networks
Humans don’t start their thinking from scratch every second. As you read this essay, you understand each word based on your understanding of previous words. You...
Weiterlesen
Reading postmortems
I love reading postmortems. They’re educational, but unlike most educational docs, they tell an entertaining story. I’ve spent a decent chunk of time reading postmortems at...
Weiterlesen
Slashdot and Sourceforge
If you’ve followed any tech news aggregator in the past week (the week of the 24th of May, 2015), you’ve probably seen the story about how...
WeiterlesenThe googlebot monopoly
TIL that Bell Labs and a whole lot of other websites block archive.org, not to mention most search engines. Turns out I have a broken website...
WeiterlesenA defense of boring languages
Boring languages are underrated. Many appear to be rated quite highly, at least if you look at market share. But even so, they’re underrated. Despite the...
WeiterlesenAdvantages of monorepos
Here’s a conversation I keep having: Someone: Did you hear that Facebook/Google uses a giant monorepo? WTF! Me: Yeah! It’s really convenient, don’t you think? Someone:...
Weiterlesen
We used to build steel mills near cheap power. Now that’s where we build datacenters
Why are people so concerned with hardware power consumption nowadays? Some common answers to this question are that power is critically important for phones, tablets, and...
Weiterlesen
Reading citations is easier than most people think
It’s really common to see claims that some meme is backed by “studies” or “science”. But when I look at the actual studies, it usually turns...
Weiterlesen
Given that we spend little on testing, how should we test software?
I’ve been reading a lot about software testing, lately. Coming from a hardware background (CPUs and hardware accelerators), it’s interesting how different software testing is. Bugs...
WeiterlesenWhat happens when you load a URL?
I’ve been hearing this question a lot lately, and when I do, it reminds me how much I don’t know. Here are some questions this question...
Weiterlesen
Goodhearting IQ, cholesterol, and tail latency
Most real-world problems are big enough that you can’t just head for the end goal, you have to break them down into smaller parts and set...
Weiterlesen
AI doesn’t have to be very good to displace humans
There’s an ongoing debate over whether “AI” will ever be good enough to displace humans and, if so, when it will happen. In this debate, the...
Weiterlesen
CPU backdoors
It’s generally accepted that any piece of software could be compromised with a backdoor. Prominent examples include the Sony/BMG installer, which had a backdoor built-in to...
Weiterlesen
Blog monetization
Does it make sense for me to run ads on my blog? I’ve been thinking about this lately, since Carbon Ads contacted me about putting an...
WeiterlesenVisualizing Representations: Deep Learning and Human Beings
In a previous post, we explored techniques for visualizing high-dimensional data. Trying to visualize high dimensional data is, by itself, very interesting, but my real goal...
Weiterlesen
What’s new in CPUs since the 80s?
This is a response to the following question from David Albert: My mental model of CPUs is stuck in the 1980s: basically boxes that do arithmetic,...
Weiterlesen
A review of the Julia language
Here’s a language that gives near-C performance that feels like Python or Ruby with optional type annotations (that you can feed to one of two static...
WeiterlesenInteger overflow checking cost
How much overhead should we expect from enabling integer overflow checks? Using a compiler flag or built-in intrinsics, we should be able to do the check...
Weiterlesen
Malloc tutorial
Let’s write a malloc and see how it works with existing programs! This is basically an expanded explanation of what I did after reading this tutorial...
Weiterlesen
Markets, discrimination, and “lowering the bar”
Public discussions of discrimination in tech often result in someone claiming that discrimination is impossible because of market forces. Here’s a quote from Marc Andreessen that...
Weiterlesen
TF-IDF linux commits
I was curious what different people worked on in Linux, so I tried grabbing data from the current git repository to see if I could pull...
Weiterlesen
One week of bugs
If I had to guess, I’d say I probably work around hundreds of bugs in an average week, and thousands in a bad week. It’s not...
Weiterlesen
Speeding up this site by 50x
I’ve seen all these studies that show how a 100ms improvement in page load time has a significant effect on page views, conversion rate, etc., but...
Weiterlesen
How often is the build broken?
I’ve noticed that builds are broken and tests fail a lot more often on open source projects than on “work” projects. I wasn’t sure how much...
Weiterlesen
Literature review on the benefits of static types
There are some pretty strong statements about types floating around out there. The claims range from the oft-repeated phrase that when you get the types to...
Weiterlesen
CLWB and PCOMMIT
The latest version of the Intel manual has a couple of new instructions for non-volatile storage, like SSDs. What’s that about? Before we look at the...
WeiterlesenTesting v. informal reasoning
This is an off-the-cuff comment for Hacker School’s Paper of the Week Read Along series for Out of the Tar Pit. I find the idea itself,...
Weiterlesen
Caches: LRU v. random
Once upon a time, my computer architecture professor mentioned that using a random eviction policy for caches really isn’t so bad. That random eviction isn’t bad...
WeiterlesenAssembly v. intrinsics
Every once in a while, I hear how intrinsics have improved enough that it’s safe to use them for high performance code. That would be nice....
WeiterlesenVerilog Won & VHDL Lost? — You Be The Judge!
This is an archived USENET post from John Cooley on a competitive comparison between VHDL and Verilog that was done in 1997. I knew I hit...
WeiterlesenGoogle wage fixing, 11-CV-02509-LHK, ORDER DENYING PLAINTIFFS’ MOTION FOR PRELIMINARY APPROVAL OF SETTLEMENTS WITH ADOBE, APPLE, GOOGLE, AND INTEL
UNITED STATES DISTRICT COURT NORTHERN DISTRICT OF CALIFORNIA SAN JOSE DIVISION IN RE: HIGH-TECH EMPLOYEE ANTITRUST LITIGATION THIS DOCUMENT RELATES TO: ALL ACTIONS Case No.: 11-CV-02509-LHK...
WeiterlesenData-driven bug finding
I can’t remember the last time I went a whole day without running into a software bug. For weeks, I couldn’t invite anyone to Facebook events...
Weiterlesen
Editing binaries
Editing binaries is a trick that comes in handy a few times a year. You don’t often need to, but when you do, there’s no alternative....
Weiterlesen
That bogus gender gap article
Last week, Quartz published an article titled “There is no gender gap in tech salaries”. That resulted in linkbait copycat posts all over the internet, from...
WeiterlesenThat time Oracle tried to have a professor fired for benchmarking their database
In 1983, at the University of Wisconsin, Dina Bitton, David DeWitt, and Carolyn Turbyfill created a database benchmarking framework. Some of their results included (lower is...
WeiterlesenWhy don’t schools teach debugging?
In the fall of 2000, I took my first engineering class: ECE 352, an entry-level digital design class for first-year computer engineers. It was standing room...
WeiterlesenDo programmers need math?
Dear David, I’m afraid my off the cuff response the other day wasn’t too well thought out; when you talked about taking calc III and linear...
Weiterlesen
Data alignment and caches
Here’s the graph of a toy benchmark1 of page-aligned vs. mis-aligned accesses; it shows a ratio of performance between the two at different working set sizes....
Weiterlesen
PCA is not a panacea
Earlier this year, I interviewed with a well-known tech startup, one of the hundreds of companies that claims to have harder interviews, more challenging work, and...
WeiterlesenWhy hardware development is hard
In CPU design, most successful teams have a fairly long lineage and rely heavily on experienced engineers. When we look at CPU startups, teams that have...
Weiterlesen
How to discourage open source contributions
What’s the first thing you do when you find a bug or see a missing feature in an open source project? Check out the project page...
WeiterlesenRandomize HN
You ever notice that there’s this funny threshold for getting to the front page on sites like HN? The exact threshold varies depending on how much...
Weiterlesen
Writing safe Verilog
Troll? That’s how people write Verilog1. At my old company, we had a team of formal methods PhD’s who wrote a linter that typechecked our code,...
Weiterlesen
Verilog is weird
Verilog is the most commonly used language for hardware design in America (VHDL is more common in Europe). Too bad it’s so baroque. If you ever...
WeiterlesenAbout danluu.com
About The Blog This started out as a way to jot down thoughts on areas that seem interesting but underappreciated. Since then, this site has grown...
WeiterlesenLatency mitigation strategies (by John Carmack)
this is an archive of an old article by John Carmack which seems to have disappeared off of the internet Abstract Virtual reality (VR) is one...
WeiterlesenKara Swisher interview of Jack Dorsey
This is a transcript of the Kara Swisher / Jack Dorsey interview from 2/12/2019, made by parsing the original Tweets because I wanted to be able...
WeiterlesenJonathan Shapiro’s Retrospective Thoughts on BitC
This is an archive of the Jonathan Shapiro’s “Retrospective Thoughts on BitC” that seems to have disappeared from the internet; at the time, BitC was aimed...
WeiterlesenHow does Boston compare to SV and what do MIT and Stanford have to do with it?
This is an archive of an old Google Buzz conversation on MIT vs. Stanford and Silicon Valley vs. Boston There’s no reason why the Boston area...
WeiterlesenAre closed social networks inevitable?
This is an archive of an old Google Buzz conversation (circa 2010?) on a variety of topics, including whether or not it’s inevetible that a closed...
WeiterlesenWork-life balance at Bioware
This is an archive of some posts in a forum thread titled “Beware of Bioware” in a now defunct forum, with comments from that forum as...
WeiterlesenHistory of Symbolics lisp machines
This is an archive of Dan Weinreb’s comments on Symbolics and Lisp machines. Rebuttal to Stallman’s Story About The Formation of Symbolics and LMI Richard Stallman...
Weiterlesen