|
To me, legacy code is simply code without tests.” — Michael Feathers If untested code is legacy code, why aren’t we testing data pipelines or ETLs (extract, transform, load)? In particular, data pipelines built in SQL are rarely tested. However, as software engineers, we know all our code should be tested. So in this post, I’ll describe how we started testing SQL data pipelines at SoundCloud.
|
|
If you’ve been reading this blog for any amount of time, you’ll know that I publish monthly book reading lists . While the format has changed slightly since my first book reading list in January of 2018 , and I didn’t publish one the following month, the posts have been a regular part of this blog for almost three years now.
|
|
To me, legacy code is simply code without tests.” — Michael Feathers If untested code is legacy code, why aren’t we testing data pipelines or ETLs (extract, transform, load)? In particular, data pipelines built in SQL are rarely tested. However, as software engineers, we know all our code should be tested. So in this post, I’ll describe how we started testing SQL data pipelines at SoundCloud.
|
|
This post is about using Python in Blender . It’s not a tutorial. It’s more of an inspiration to learn and experiment with Python. Imagine you work on a piece. The first stage is very experimental. You look for what works and what doesn’t. At some point the piece and the process take shape. Some things become repetitive. It’s very useful to notice those patterns early and optimize them. Lets say I’m working in ZBrush and I want to re..
|
|
This week, Snyk was recognized by Comparably’s employer awards in 2 categories: ‘Happiest Employees’ and ‘Best Compensation’.
|
|
SourMint: iOS remote code execution, Android findings, and community response
-
snyk.io
-
5 years ago
-
eng
As part of this ongoing effort, Snyk has leveraged new information to conduct additional research into the Mintegral SDK. As a result of this research, additional findings have been uncovered.
|
|
Learn more about OWASP top 10 vulnerabilities in order to avoid frustrating and often costly application security failures.
|
|
Exploring the WDAC Microsoft Recommended Block Rules: VisualUiaVerifyNative
-
bohops.com
-
5 years ago
-
eng
Introduction If you have followed this blog over the last few years, many of the posts focus on techniques for bypassing application control solutions such as Windows Defender Application Control (WDAC)/Device Guard and AppLocker. I have not been blogging as much lately but wanted to get back into the rhythm and establish a similar theme […]
|
|
Let me start with a picture. int main() {float f ;char c;int d,o;while(scanf( "%d%c%d ",&d,&c,&o) >0){c&=31;for(f=!(c>>4)*55,c=(c*8/5+8)%12+o* 12-24;c--;f*=1.0595); for(d=16e3/d;d--; putchar(d*f *.032)) ;}} I don’t really draw well, so I used formatted C code instead. That was supposed to be a triangular sound wave written in C. In fact, this very C code plays two-octave melodies written in text notation from stdin. It’s only 160 bytes, fit..
|
|
While working with a client, we had a requirement to perform bulk insert/update using Retool table and Redshift database. For this situation, We had to loop through the table records and execute a dynamic SQL query in Redshift. Redshift database supports execution of dynamic SQL with the help of Prepared Statements or Stored Procedures. Prepared Statements We use prepared statements when we want to execute dynamic SQL queries directly witho..
|
|
Let me start with a picture. int main() {float f ;char c;int d,o;while(scanf( "%d%c%d ",&d,&c,&o) >0){c&=31;for(f=!(c>>4)*55,c=(c*8/5+8)%12+o* 12-24;c--;f*=1.0595); for(d=16e3/d;d--; putchar(d*f *.032)) ;}} I don’t really draw well, so I used formatted C code instead. That was supposed to be a triangular sound wave written in C. In fact, this very C code plays two-octave melodies written in text notation from stdin. It’s only 160 bytes, fit..
|
|
In 2017, I co-founded Moonlight as a professional community for software developers with Emma Lawler. We were both leaving San Francisco, and wanted to make it easier for all developers to find specia...
|
|
Table of Contents Do We Really Need Plug-ins? Plug-ins in Layered Java Applications Class Unloading in Practice If Things Go Wrong Learning More Layers are sort of the secret sauce of the Java platform module system (JPMS): by providing fine-grained control over how individual JPMS modules and their classes are loaded by the JVM, they enable advanced usages like loading multiple versions of a given module, or dynamically a....
|
|
Table of Contents Do We Really Need Plug-ins? Plug-ins in Layered Java Applications Class Unloading in Practice If Things Go Wrong Learning More Layers are sort of the secret sauce of the Java platform module system (JPMS): by providing fine-grained control over how individual JPMS modules and their classes are loaded by the JVM, they enable advanced usages like loading multiple versions of a given module, or dynamically a....
|
|
Angular Multiple Language Support using Internationalization (i18n)
-
www.9lessons.info
-
5 years ago
-
eng
Modern web and mobile user experiences is a worldwide thing. Localization of your application (supporting multiple languages) will help you to reach worldwide people. Angular is offering Internationalization(i18n) plugins to enrich your application with multiple languages. In this post I will discuss the implementation with lazy loading design pattern with supporting dynamic content. Take a quick look at the live demo and choose the langua..
|
|
Learn how to control element sizing, maintain proper spacing, and implement fluid typography using these well-supported CSS functions.
|
|
Update: The project has been abandoned as it was quite ineffective, it seemed. The room does not exist anymore. I think I have found a method to efficiently identify and act against lurker bots on Matrix. If you are not aware what I am talking about, read the linked article - note: the "vigilant user" mentioned in there is me. So, what is this method? I have found another sign of how to identify at least some of them - similarly to t....
|
Did ESLint tell you to add a function to your dependency array, and now you're getting infinite re-renders? Let's learn how useEffect can help.
|
|
We’re ironically searching for counterexamples to the Riemann Hypothesis. Setting up Pytest Adding a Database Search strategies In the last article, we improved our naive search from “try all positive integers” to enumerate a subset of integers (superabundant numbers), which RH counterexamples are guaranteed to be among. These numbers grow large, fast, and we quickly reached the limit of what 64 bit integers can store. Unbounded integer ari..
|
|
We’re ironically searching for counterexamples to the Riemann Hypothesis. Setting up Pytest Adding a Database Search strategies In the last article, we improved our naive search from “try all positive integers” to enumerate a subset of integers (superabundant numbers), which RH counterexamples are guaranteed to be among. These numbers grow large, fast, and we quickly reached the limit of what 64 bit integers can store. Unbounded integer ari..
|
|
We’re ironically searching for counterexamples to the Riemann Hypothesis. Setting up Pytest Adding a Database Search strategies In the last article, we improved our naive search from “try all positive integers” to enumerate a subset of integers (superabundant numbers), which RH counterexamples are guaranteed to be among. These numbers grow large, fast, and we quickly reached the limit of what 64 bit integers can store. Unbounded integer ari..
|
|
Below see two kernel density estimations. What could you say about them? Most likely, you say that the first plot is based on a uniform distribution, and the second one is based on a multimodal distribution with four modes. Although this is not obvious from the plots, both density plots are based on the same sample: 21.370, 19.435, 20.363, 20.632, 20.404, 19.893, 21.511, 19.905, 22.018, 19.93, 31.304, 32.286, 28.611,....
|
|
Below see two kernel density estimations. What could you say about them? Most likely, you say that the first plot is based on a uniform distribution, and the second one is based on a multimodal distribution with four modes. Although this is not obvious from the plots, both density plots are based on the same sample: 21.370, 19.435, 20.363, 20.632, 20.404, 19.893, 21.511, 19.905, 22.018, 19.93, 31.304, 32.286, 28.611,....
|
|
Those who ever owned an old Nokia phone like 3310 or 3210 might still remember its wonderful ability to compose your own ringtones straight on the phone’s keyboard. By arranging notes and pauses you could end up with a popular tune beeped out of the phone’s speaker, and furthermore, you could share it with your friends! If you missed that era, here’s how it looked like: Unimpressed? Well, trust me, it was really cool back then especially if..
|
|
Those who ever owned an old Nokia phone like 3310 or 3210 might still remember its wonderful ability to compose your own ringtones straight on the phone’s keyboard. By arranging notes and pauses you could end up with a popular tune beeped out of the phone’s speaker, and furthermore, you could share it with your friends! If you missed that era, here’s how it looked like: Unimpressed? Well, trust me, it was really cool back then especially if..
|
|
Return on Data: When governments fail to make surveillance useful
-
nikhilism.com
-
5 years ago
-
eng
There is this common refrain about how companies have data about you and could do bad things. Yet governments often pass surveillance laws that are much worse, and by definition, you can’t “vote with your wallet” for them. So in a world where I’m already giving data to third parties, it is useful to ask what I get in return. If we are talking about corporations, we get ads! Yes, but we also get:
|
|
Return on Data: When governments fail to make surveillance useful
-
nikhilism.com
-
5 years ago
-
eng
There is this common refrain about how companies have data about you and could do bad things. Yet governments often pass surveillance laws that are much worse, and by definition, you can’t “vote with your wallet” for them. So in a world where I’m already giving data to third parties, it is useful to ask what I get in return. If we are talking about corporations, we get ads! Yes, but we also get:
|
|
When the pandemic hit earlier this year, schools around the globe quickly embraced online teaching to continue their curriculum. While online teaching wasn’t entirely new in this space, it certainly wasn’t the norm. This meant that many teachers had to adapt quickly, as these 2 funny videos illustrate: https://www.youtube.com/watch?v=CCe5PaeAeew https://www.youtube.com/watch?v=Zy_y9yOrgxk However, I’ve loved every part of this trans....
|
|
When the pandemic hit earlier this year, schools around the globe quickly embraced online teaching to continue their curriculum. While online teaching wasn’t entirely new in this space, it certainly wasn’t the norm. This meant that many teachers had to adapt quickly, as these 2 funny videos illustrate: https://www.youtube.com/watch?v=CCe5PaeAeew https://www.youtube.com/watch?v=Zy_y9yOrgxk However, I’ve loved every part of this trans....
|
|
Phishing: Persuading People through a Voice Synthesized by AI - Part 1
-
serhack.me
-
5 years ago
-
eng
I get between 10 to 20 emails per day and, usually, more than half of them are phishing attempts. Phishing attempts are a type of email scam that typically aims to obtain personal data of the victim, including username and password for email accounts and popular services (Gmail, Hotmail, mail.ru, Twitter, Amazon, etc.), through pages forged ad hoc to simulate login sections. -Continue to read the article on SerHack.me
|
|
Circular gradients are commonly used in pie or doughnut charts to change the colour of segment as the angle around the center of the chart changes. In many non web platforms, the ability to generate these gradients is provided as part of the standard APIs. For example, Android provides a SweepGradient. In the browsers, only Linear and Radial gradients are provided. Thus, if we want to a circular gradient, we’ll need to create our own.
|
|
This is an answer to Antoine Veuiller ’s article, an Introduction to Flaky Tests by Example , in which he shares his experience on tackling unstable tests. And I’m the author of the flaky tests he’s talking about! 😬 Story time! ¶ I started designing and implementing Scaleway’s billing pipeline …
|
|
This is an answer to Antoine Veuiller ’s article, an Introduction to Flaky Tests by Example , in which he shares his experience on tackling unstable tests. And I’m the author of the flaky tests he’s talking about! 😬 Story time! ¶ I started designing and implementing Scaleway’s billing pipeline …
|
|
Been playing around with Swift Package Manager (SPM) . Creating a new Swift package (ie. project) is pretty simple. To create a library package, we can use the following: swift package init --type library Alternatively, to create a command-line utility use: swift package init --type executable Turns out, there are a few options: empty, library, executable, system-module, manifest. With a little elisp, we can write a completing fu....
|
|
We are all familiar with a traditional office suite - a word processor, a spreadsheet, a presentation program, maybe a diagramming or note-taking app. We have seen it all in Microsoft Office and Google Docs. Those are really powerful and large. But what would be the most minimal amount of code required to build an office suite? platform Obviously, our office suite won’t be a desktop GUI app - those require plenty of code and efforts to buil..
|