|
Create Ebay Scraper in Python using Scraper API Learn how to create an eBay data scraper in Python to fetch item details and price.
-
blog.adnansiddiqi.me
-
5 years ago
-
eng
In this post of ScrapingTheFamous, I am going o write a scraper that will scrape data from eBay. eBay is an online auction site where people put their listing up for selling stuff based on an auction. Like before, we will be writing the two scripts, one to fetch listing URs and store in a text file and the other to parse those links. The data will be stored in JSON format for further processing. I will be using Scraper API service for parsi....
|
|
Cloning git repositories is a pretty common task. For me, it typically goes something like: Copy git repo URL from browser. Drop to Emacs eshell. Change current directory. Type "git clone ". Paste git repo URL. Run git command. Change directory to cloned repo. Open dired. No biggie, but why go through the same steps every time? We can do better. We have a hyper malleable editor, so let's get it to grab the URL from clipboard and do its ....
|
|
By hosting your static site in GitLab Pages you don’t have to worry about managing a web server, but just as “with great power comes great responsibility”, with less responsibility you must also relinquish some control. If you inspect your site’s headers you will find that GitLab’s servers don’t compress your assets, which makes them weigh up to 75% more than necessary! The good news is that you can get that compression without having to to..
|
|
Measuring Java JVM thread activity in Linux with task state sampling
-
tanelpoder.com
-
5 years ago
-
eng
FYI: I will be speaking about similar topics at P99Conf in Oct 2023 (online, free event) There are plenty of JVM profilers out there, but before attaching with a profiler, you can get a high-level overview by just sampling the Linux /proc/PID/comm and /proc/PID/stat fields to see which JVMs threads are most active and whether they’re burning CPU or are blocked by some I/O. When creating threads in Java, you can name them using the f..
|
|
Measuring Java JVM thread activity in Linux with task state sampling
-
tanelpoder.com
-
5 years ago
-
eng
FYI: I will be speaking about similar topics at P99Conf in Oct 2023 (online, free event) There are plenty of JVM profilers out there, but before attaching with a profiler, you can get a high-level overview by just sampling the Linux /proc/PID/comm and /proc/PID/stat fields to see which JVMs threads are most active and whether they’re burning CPU or are blocked by some I/O. When creating threads in Java, you can name them using the f..
|
|
Everywhere I look in the tech world, I see everything everyone does being framed as "solving problems". "What problem are you trying to solve?" is a question asked at the start of many project inception documents. It occupies an early slide in most presentations. Whole company missions are framed as solving a particular problem. Many engineers list problem solving as one of their core skills. My motivation for this post is to simply state....
|
|
Table of Contents Bonus: Schema Creation The Testcontainers project is invaluable for spinning up containerized resources during your (JUnit) tests, e.g. databases or Kafka clusters. For users of JUnit 5, the project provides the @Testcontainers extension, which controls the lifecycle of containers used by a test. When testing a Quarkus application though, this is at odds with Quarkus' own @QuarkusTest extension; it’..
|
|
Table of Contents Bonus: Schema Creation The Testcontainers project is invaluable for spinning up containerized resources during your (JUnit) tests, e.g. databases or Kafka clusters. For users of JUnit 5, the project provides the @Testcontainers extension, which controls the lifecycle of containers used by a test. When testing a Quarkus application though, this is at odds with Quarkus' own @QuarkusTest extension; it’..
|
|
A comprehensive evaluation of the M1 MacBook Air as a development machine, covering Xcode performance, compatibility issues, and the transition challenges for developers.
|
|
I am an avid Emacs user. I’m using it right now to compose this post. I use it every single day for everything from work to school to personal notes. Most of my activity on GitHub comes from me tweaking little things in my configuration files. I now have an editor that perfectly fits my hands. Emacs is a big part of my life. I’m afraid it’s dying. Richard Stallman, one of the principle creators of Emacs and the head of the GNU Project....
|
|
I am an avid Emacs user. I’m using it right now to compose this post. I use it every single day for everything from work to school to personal notes. Most of my activity on GitHub comes from me tweaking little things in my configuration files. I now have an editor that perfectly fits my hands. Emacs is a big part of my life. I’m afraid it’s dying. Richard Stallman, one of the principle creators of Emacs and the head of the GNU Project....
|
|
Introduction SailfishOS is a mobile operating system based on Linux. It is today one of the few alternatives to Android and iOS on the smartphone market. This article is a feedback from a Sony Xperia X under SailfishOS that I used as my main smartphone during the year 2019. The Sony Xperia X was not chosen at random, since it is one of the officially supported smartphones by SailfishOS . It is now available for around 70€ on the i..
|
|
Let’s take a look at some of the popular Infrastructure as Code tools and what security hardening measures you can apply at the code level to protect your applications and platforms.
|
|
A real-time game from scratch - Physics, TDD and Core Game Loops [4]
-
simonam.dev
-
5 years ago
-
eng
Previous Entries 1 - Initial Setup 2 - WebSockets 3 - PixiJS Introduction Moving a spinning yellow box is not particularly interesting or…
|
|
One of the best ways to learn something well is to teach it. This week on the show, we have Kelly Schuster-Paredes and Sean Tibor from the Teaching Python podcast. Sean and Kelly teach middle school students Python and share their art and science of teaching Python on their podcast. They wanted to come on the show to talk about the Real Python articles, quizzes, and other resources they use when teaching their students.
|
|
Using postgres specific SQL syntax we can create autogenerated column which subtracts two dates and stores them as interval. The age function is also null-safe, so if time_ended or time_started it will not crash. ALTER TABLE session ADD COLUMN duration interval GENERATED ALWAYS AS (age(time_ended, time_started)) STORED;
|
|
Tips on how to get the most out of the Snyk CLI as a tool to test, monitor, and remediate known vulnerabilities in your applications
|
|
There are countless tutorials and example code for building an Android keyboard, but all of them use Java and the deprecated KeyboardView and Keyboard classes from android.inputmethodservice. If you’re building an Android keyboard in 2020 you want to be using Kotlin and designing your own layout from scratch.
|
|
Emulating linux/AMD64 userland: interpreting an ELF binary
-
notes.eatonphil.com
-
5 years ago
-
eng
In this post we'll stumble toward a working emulator for a barebones C program compiled for linux/AMD64. The approach will be slightly more so based on observation than by following a spec; a great way to quickly become familiar with a topic, and a bad way to guarantee correctness. The goal: $ cat tests/simple.c int main () { return 4 ; } $ gcc tests/simple.c $ go build -o main $ ./main a.out ....
|
|
Here’s a list of reasons why SELECT * is bad for SQL performance, assuming that your application doesn’t actually need all the columns. When I write production code, I explicitly specify the columns of interest in the select-list (projection), not only for performance reasons, but also for application reliability reasons. For example, will your application’s data processing code suddenly break when a new column has been added or the column ..
|
|
Here’s a list of reasons why SELECT * is bad for SQL performance, assuming that your application doesn’t actually need all the columns. When I write production code, I explicitly specify the columns of interest in the select-list (projection), not only for performance reasons, but also for application reliability reasons. For example, will your application’s data processing code suddenly break when a new column has been added or the column ..
|
|
Command injection: how it works, what are the risks, and how to prevent it
-
snyk.io
-
5 years ago
-
eng
Command injection attacks—also known as operating system command injection attacks—exploit a programming flaw to execute system commands without proper input validation, escaping, or sanitization, which may lead to arbitrary commands executed by a malicious attacker.
|
|
Mexico uses asymmetric encryption for university diplomas and taxes.
-
danielsada.tech
-
5 years ago
-
eng
I recently graduated, and in order to get my official graduation title I needed to get my private and public key from the government. That’s right, you go to the government’s office, certify that you are who you are, and you’ll get a private and public key in an USB key from the government which you can use to do all your bureaucracy. You also get a TaxID which is comprised of
|
|
Leveraging a Manager Weekly Newsletter for Team Communication
-
developers.soundcloud.com
-
5 years ago
-
eng
I started my journey as an Engineering Manager at SoundCloud close to a year ago. This came after working as a Software Engineer for more…
|
|
Mexico uses asymmetric encryption for university diplomas and taxes.
-
danielsada.tech
-
5 years ago
-
eng
I recently graduated, and in order to get my official graduation title I needed to get my private and public key from the government. That’s right, you go to the government’s office, certify that you are who you are, and you’ll get a private and public key in an USB key from the government which you can use to do all your bureaucracy. You also get a TaxID which is comprised of
|
|
Leveraging a Manager Weekly Newsletter for Team Communication
-
developers.soundcloud.com
-
5 years ago
-
eng
I started my journey as an Engineering Manager at SoundCloud close to a year ago. This came after working as a Software Engineer for more…
|
|
This post suggests some best practices, and discusses how maintainers and developers can adopt DevSecOps tools for open source projects to better improve their security posture.
|
|
If you're using useEffect to fetch data, chances are you've either run into a race condition, or have one without realising it. Let's learn how to fix them in this article.
|
|
P² quantile estimator: estimating the median without storing values
-
aakinshin.net
-
5 years ago
-
eng
Imagine that you are implementing performance telemetry in your application. There is an operation that is executed millions of times, and you want to get its “average” duration. It’s not a good idea to use the arithmetic mean because the obtained value can be easily spoiled by outliers. It’s much better to use the median which is one of the most robust ways to describe the average. The straightforward median estimation approach requires ....
|
|
Jane Street is running a Kaggle contest based on a real problem with real financial data. If you like ML projects, or think you might, head over and check it out . We think it’s a pretty fun one. The prizes are pretty good too, with a total $100K being paid out.
|
|
Jane Street is running a Kaggle contest based on a real problem with real financial data. If you like ML projects, or think you might, head over and check it out . We think it’s a pretty fun one. The prizes are pretty good too, with a total $100K being paid out.
|
|
P² quantile estimator: estimating the median without storing values
-
aakinshin.net
-
5 years ago
-
eng
Imagine that you are implementing performance telemetry in your application. There is an operation that is executed millions of times, and you want to get its “average” duration. It’s not a good idea to use the arithmetic mean because the obtained value can be easily spoiled by outliers. It’s much better to use the median which is one of the most robust ways to describe the average. The straightforward median estimation approach requires ....
|
|
You can find examples online of the .gitlab-ci.yml file to use for compiling Android apps (including one on GitLab’s Blog ), but they are all now outdated since Google made several breaking changes to the naming, directory structure, and environment variables.
|
|
Before you begin The following applies to minimal websites that focus primarily on text. It does not apply to websites that have a lot of non-textual content. It also does not apply to websites that focus more on generating revenue or pleasing investors than being inclusive. This is a “living document” that I add to as I receive feedback. See the updated date and changelog after the post title. If you find the article too long, just re....
|
|
Welcome to the Snyk Monthly Vulnerability Profile. This month we’re looking at a buffer overflow vulnerability discovered in the FreeType package used by Chromium and the subsequent work by Snyk to locate open source packages impacted by inclusion of vulnerable Chromium components.
|
|
Made pulled pork a couple of times. Freestyled a bit. No expert here, but result was yummie. Grind/blend spices 2 teaspoons smoked paprika 2 teaspoons cumin seeds 2 teaspoons whole pepper corn mix 2 teaspoons chilly flakes If spices are whole, grind or blend them. Set aside. Optionally: Substitute 1 teaspoon of paprika with chipotle pepper. Mix into a paste 2 tablespoons honey 1 teaspoon of dijon mustard Mix the honey, musta..
|
|
A fast and efficient Instagram Scraper based on Torpy. Scrapes posts for multiple hashtags and location ids .
|