|
Handle Irregular Bursts of Files using EventBridge and Glue Workflow
-
www.vladsiv.com
-
2 years ago
-
eng
Exploring ways of handling irregular and sudden bursts of multiple files for data processing using event driven architecture on AWS. This blog posts showcases how to use S3 notification with EventBridge to trigger a Glue Workflow that has number of events and batch window trigger conditions.
|
|
How I used jq and Rust to build a repo of my Exercism solutions that showed how they evolved over time Read the whole thing .
|
|
Repository: @knadh/otpgateway GitHub release page: v3.5.1 Changelog 15afcad chore: upgrade deps
|
|
How I used jq and Rust to build a repo of my Exercism solutions that showed how they evolved over time Read the whole thing .
|
|
Exploring and discovering unfamiliar codebases is always a challenge. In this blog post, I will introduce a novel way to explore a new codebase by looking
|
|
Handle Irregular Bursts of Files using EventBridge and Glue Workflow
-
www.vladsiv.com
-
2 years ago
-
eng
Exploring ways of handling irregular and sudden bursts of multiple files for data processing using event driven architecture on AWS. This blog posts showcases how to use S3 notification with EventBridge to trigger a Glue Workflow that has number of events and batch window trigger conditions.
|
|
Suppose we have a large collection of documents, and we wish you identify which documents are approximately the same as each other. For instance, we may have crawled the web over some period of time, and expect to have fetched the “same page” several times, but to see slight differences in metadata, or that we have several revisions of a page following small edits. In this post I want to explore the method of approximate deduplication via J..
|
|
Suppose we have a large collection of documents, and we wish you identify which documents are approximately the same as each other. For instance, we may have crawled the web over some period of time, and expect to have fetched the “same page” several times, but to see slight differences in metadata, or that we have several revisions of a page following small edits. In this post I want to explore the method of approximate deduplication via J..
|
|
My ebooks have surpassed the 200,000 downloads mark. English rules, but it’s India in the lead, with almost 5x the downloads of the US. Meanwhile, 2024 looks like Indonesia’s year, with more downloads in Indonesian than in English ! Google… Continue reading →
|
|
For the last four months I’ve been developing a custom container image builder, collaborating with Outerbounds1. The technical details of the builder itself might be the topic of a future article, but there’s something surprising I wanted to share already: you can use S3 as a container registry! You heard it right. All it takes is to expose an S3 bucket through HTTP and to upload the image’s files to specific paths.
|
|
As an Emacs user, I eventually made the leap over to dired as my file manager of choice. Dired has magical things like wdired . But this post isn't so much about dired and more about the occasional need to peek at media files (images, audio, and video) from Emacs (including dired). To view images in Emacs, there's image mode , a fantastic major mode for taking a quick look without leaving your editor. Image mode strikes a great balanc....
|
|
I’ve made some big changes to my blog! This post is just for me to document what I’ve done and why, as well as to test some of the new features I’ve added. New fonts # First off: new fonts! I am using Valkyrie for the body text and Concourse for the headings. I’ve increased the font size on larger displays for added legibility. I also made the background a little darker for better contrast. Margin notes and sidenotes # ....
|
|
I’ve made some big changes to my blog! This post is just for me to document what I’ve done and why, as well as to test some of the new features I’ve added. New fonts # First off: new fonts! I am using Valkyrie for the body text and Concourse for the headings. I’ve increased the font size on larger displays for added legibility. I also made the background a little darker for better contrast. Margin notes and sidenotes # ....
|
|
Recently, Vanguard announced the end of their solo 401k program, which left me with a decision to make about my solo 401k account. Should I just close it? Transfer the money to my IRA? After some research and consideration, I decided to transfer my solo 401k account to Fidelity. Here’s a detailed account of my experience during this transition.
|
New DEF CON 32 parrrty just dropped! Join us Saturday August 10 for ‘Yo Ho Ho, a Pirate’s NIght for Me! There’ll be a best-dressed pirate contest with a 460 dollar prize and entertainment from O’Craven (Insta: OCRAVEN), NorCal’s most swashbuckling Celtic Pirate Rock Band. For details and updates keep an eye on the DEF CON Music Page . We’ll see you there!
|
|
Personal life update: Yee Aun and I got married! Some rapid info, in case you're wondering: Back in February, on the beach in Santa Monica, in a family-only ceremony. Yes, it feels great. Yes, I do save lots of time by saying "my wife" instead of "my fiancee" (the extra syllables add up when you say them so often). No, not much has changed in married life otherwise. Many people have told us, "Just wait 'til you have kids." We believe..
|
|
Introduction: In this segment, Bill delves into the fundamental aspects of authentication and authorization, equipping Go developers with essential knowledge and advanced tools to enhance the security of their applications. Through practical examples and detailed explanations, he unpacks the intricacies of these concepts, demonstrating their crucial role in protecting and managing access to your software systems. Learn the distinct rol..
|
|
To continue with our tradition of hand-me-down Macs , dkbox gifted me his ancient PowerBook3,5 (aka TiBook), which I’m now considering using as my main machine for the upcoming Old Computer Challenge v4 (update: conclusion ). The machine has pretty decent specs (for 2002): a 32-bit, single-core PowerPC CPU clocked at 867Mhz; 512MB of RAM; 40GB of spinning rust; a USB2.0 expansion card; and even digital video output via DVI! Most of ..
|
|
Benchmarking rust compilation speedups and slowdowns from sccache and -Zthreads
-
neosmart.net
-
2 years ago
-
eng
Just a PSA from one rust developer to another: if you use sccache, take a moment to benchmark a clean build1 of your favorite or current project and verify whether or not having RUSTC_WRAPPER=sccache is doing you any favors. I’ve … Continue reading → The post Benchmarking rust compilation speedups and slowdowns from sccache and -Zthreads first appeared on The NeoSmart Files .
|
|
At the heart of RavenDB, there is a data structure that we call the Page Translation Table. It is one of the most important pieces inside RavenDB. The page translation table is basically a Dictionary
|
|
Deze vind ik interessant: De belangrijkste beslissing die je maakt is dat je in een goede bui bent. Holiday stelt zichzelf geen doelen maar doet gewoon wat hij leuk vindt. Het resultaat komt dan vanzelf. Als succes je geen beter persoon maakt, dan is het geen succes. Uitchecken bij hotels is voor amateurs. Je kan weggaan wanneer je wil. Zeg vaker aardige, complimenteuze dingen.
|
|
Microblog: Frank M Taylor gaat helemaal los op wat er allemaal mis is met Front-end Development
-
blog.frankmtaylor.com
-
2 years ago
-
nld
Waar het volgens Taylor op neerkomt is dat het allemaal moet gaan om de content. Het is de afgelopen jaren veel te complex geworden en de meeste websites hebben meer dan voldoende aan simpele HTML en CSS om statische informatie te tonen. Denk gewoon even logisch na, aldus Taylor.
|
|
Microblog: Eetgewoontes aanpassen voor een beter klimaat en dierwelzijn
-
ourworldindata.org
-
2 years ago
-
nld
Twee dingen die ik meeneem uit dit artikel van Hannah Ritchie: Kip vervangen voor rund verlaagt je ‘carbon footprint’ met wel 80%. Echter moet je meer kippen slachten om tot dezelfde hoeveelheid vlees te kopen. Beter voor het milieu maar slechter voor de dieren. Als ik voedselkeuzes wil maken die beter zijn voor het klimaat en dieren moet ik, uiteraard, switchen naar vegetarisch en het liefst vegan opties.
|
Sushi is such an interesting meal that leaves you full, but not stuffed and a blast of combination of flavors.
|
|
Kogan.com Engineering Growth Paths: From Pricing Manager to Data Engineer
-
devblog.kogan.com
-
2 years ago
-
eng
Committed to learning and continuous improvement, Kogan.com’s Engineering team develops its engineering talent through giving and taking responsibility, co-creation, mentorship, and internal mobility opportunities to grow and advance their careers. There are opportunities for Engineers at Kogan.com regardless of background. Some engineers at Kogan.com are Individual Contributors, Tech Leads or People Managers – and engineering growth paths ....
|
|
A database does not need a write-ahead log (WAL) to achieve durability. A database can write its long-term data structure durably to disk before returning to a client. Granted, this is a bad idea! And granted, a WAL is critical for durability by design in most databases. But I think it's helpful to understand WALs by understanding what you could do without them. So let's look at what terrible design we can make for a durable databas....
|
|
Making up your own house rules can be a really fun part of playing board games. It lets you wear the shoes of a game designer - not just play the game, but also play with the game. Sometimes changing the rules makes for some really spicy games, as even a trivial tweak can have a ripple effect and unexpected consequences. But we’re here to learn and to have fun - so let’s play, shall we?
|
|
Bookmarks for July 2024: 4 links - Reintroducing engineering thinking in the...; Process doesn’t scale. Knowledge does. - b..., and more.
|
|
Bookmarks for July 2024: 4 links - Reintroducing engineering thinking in the...; Process doesn’t scale. Knowledge does. - b..., and more.
|
I always wanted my hair to be different. A lot of us felt that way. Many still do. I wanted to look like Kelly from the Bad News Bears . Like Ace Frehley, the lead guitarist in Kiss. Long and not quite straight. Or like John Travolta’s dance teacher, Deney Terrio. Like Shaun Cassidy. Musical, dreamy, avian. With hormones came discord. I wanted my hair to be messy. The right kind. Like Andrew McCarthy or Kurt Cobain. I wanted it to lo....
|
|
Hey Lainons. Though I've been into tech since ~6, I've noticed that programming specifically seems to evade me at every turn. Learning Bash and Linux was easy, but every time I try to learn programming (C, Rust, anything really) I gradually stop caring, and when I eventually come back to it I always have to start from scratch due to having forgotten everything. How do y'all motivate yourselves to do this? It's not as if I'm not intereste..
|