|
Newcoder Scraping (Part 4) SQLAlchemy Session Basics Context I struggled with structuring database sessions in my python program. Reading through a few articles and tutorials on SQLAlchemy best practices, and studying Kenneth Reitz’s fantastic requests library, I realize I want a clean interface to the package. Kenneth does this by having an “api” module that wraps/uses the underlying classes/objects into neat little functions, so ..
|
|
Ten Haaf Project temporary, Geldersekade 30, Amsterdam June 2017 In this exhibition, three different scales of time are presented: elliptic(1), sluggish(2), looped(3). The Gait depict one being on a walk, each drawings being a step. All things, including the walker itself, are transforming at the point it is framed. A Man on The Bridge comes from a painting where one mysterious figure is walking down a bridge. In this publication..
|
|
750 words, 3 minutes. The Case For Default Deny What’s free, permanently reduces your exposure to a range of potential vulnerabilities, requires no maintenance, and takes only a few minutes to implement? Most web servers are installed to serve content to unauthenticated users on the Internet. Most only have a finite list of URLs or a specific number of web apps. I’ve always thought it strange that they install in a default-permit mode.
|
A lot of beginners under-appreciate the degree to which googling things is part of a programmer’s job,” says @steveklabnik #wednesdaywisdom pic.twitter.com/FnXo3rBfPb — Glitch (@glitch) May 31, 2017 That quote is true, and it's a specific example of a more general
|
|
Small class, intended to be used as a callback for preg_replace_callback to obfuscate email addresses. You can also simply pass a string in rather than being obliged to use preg_replace_callback Supports a number of obfuscation modes part - e.g. test@ full - e.g. none - e.g. test@example.com htmlencode - Generates a javascript snippet to write the address in document.write('test'); document.write('@');..
|
|
This is the first in a 2 part series. You can read the second part here. "Our intuition about the future is linear. But the reality of information technology is exponential, and that makes a profound difference. If I take 30 steps linearly, I get to 30. If I take 30 steps exponentially, I get to a billion." – Ray Kurzweil
|
|
The Changing Face of Retail: News Series with the BRC and ITN
-
www.thoughtworks.com
-
9 years ago
-
eng
The British Retail Consortium (BRC) and ITN Productions have created a 16 part current affairs programme exploring the transformation of the retail industry, and the implications for retailers. “The Changing Face of Retail" premiered at the BRC’s Retail 2020 event in London and featured opinions and examples from retail leaders across the UK. Thoughtworks is proud to have been involved with our partners Shop Direct, the UK's second largest ..
|
|
I’ve discussed properties a couple of times before but never in a condensed video tutorial like the one we have here. In this video we review the value proposition behind properties as a step by step process. I hope to create more elaborate properties demos that would show off the full capabilities of this API. Discussion Join the conversation via GitHub Discussions.
|
|
Context I stumbled across Sandi Metz’s talk a few days ago, and found time to watch it today. I’m no expert on Object Oriented design, so this was definitely an eye opener. Take Aways ¶ Don’t use conditionals for checking for nil. Don’t use inheritance to share code. Learn that non-physical/non-traditional things can be modeled as objects. Get into the habit of composing a class (object), then create other classes (roles) and inject ..
|
|
SVG (Scalable Vector Graphics) is an XML based image format that represents an image as vectors instead of pixels (raster). An SVG file is represented by the set of lines & shapes that make it and can thus be rendered at any resolution without quality degradation due to scaling. It has some other neat tricks up its sleeve but I’m only going to discuss that specific feature today.
|
|
After three great days at the PyCon US 2017 in Portland, OR Hendrik and I decided to participate in the development sprints succeeding the conferece. The code sprints are an essential part of PyCon, and a chance to meet some of the maintainers and contributors of various open source projects. For us it was the first time attending a code sprint. The day before the sprint there was a session helping people to set up Git, Python (including vi..
|
|
Algorithmic Solution to My Insomnia (Hacker News) . Melatonin - Gwern.net . Melatonin: Much More Than You Wanted To Know | Slate Star Codex .
|
|
Something that’s been clear as day from my first week here at Thoughtworks is the distinct lack of clones in the company. I've found that Thoughtworkers come from really diverse backgrounds from across the world. And that is one of our inherent strengths. I'm Jonathan and I'm in my eighth month of being a Thoughtworker. As a member of the Recruiting team in Singapore, I’ve found a place of work that I can call my second home without hesitat..
|
|
A developer recently asked me why Display is called Display when it has such a broad purpose? The reason is historic with roots in Codename One’s origin back in 2007, when we formed the company Chen advocated for a rename of that class and I disagreed. In retrospect I was wrong, the name doesn’t work. This isn’t something we can easily fix but it’s something we can replace and improve…
|
|
The amount of value we assign to our time could be a self-fulfilling prophecy. If we value our time at $1000, then it is actually possible to achieve a payoff in the future, which when prorated for number our hours spent working towards it and adjusted for inflation and so on, will amount to $1000 for that very next hour. If I had a low value on my time, I would be more likely to waste it. I could be watching TV excessively, beyond the po....
|
|
Image masking allows us to adapt an image which we acquired from an external source to fit our design e.g. if we want to show an image cropped to a circle we could apply a mask to it in order to get an intelligent crop. This is a very powerful tool as a designer can supply a hardcoded mask image and build some pretty complex shapes that include an alpha channel as well (making it superior to shape clipping).
|
|
Link to album This month I jumped on a plane to one of these places that I had expected not to see anytime soon, that always seems so exotic when you see and read about it. I was joining the 30th birthday party of a friend of my girlfriend’s which took place in Venice. As an added bonus the Biennale (Feneyjartvíeyringurinn) was happening this year, so we got to experience one of the more interesting art events in the world with friends.
|
|
Link to album This month I jumped on a plane to one of these places that I had expected not to see anytime soon, that always seems so exotic when you see and read about it. I was joining the 30th birthday party of a friend of my girlfriend’s which took place in Venice. As an added bonus the Biennale (Feneyjartvíeyringurinn) was happening this year, so we got to experience one of the more interesting art events in the world with friends.
|
|
I’m currently reading “The Linux Programming Interface” and I intend to use this blog as a way to share what i’m learning (to make sure I’m actually learning). In one of the first chapters there is an exercise about the reboot(2) syscall and some magic numbers that are used as parameters. The reboot(2) syscall has the following signature: int reboot ( int magic, int magic2, int cmd, void * arg); As can be read from ..
|
|
Basic example of how to generate, and encrypt arbitrary strings (or text files) with a One Time Pad /OTP In principle, where the pads are sufficiently controlled, One Time Pads cannot be cracked in any reasonable timeframe. The real challenge lies in distributing the pads themselves securely, and independantly of the ciphertext. For most people and uses, they are effectively unusable This implementation does have some known limitations..
|
|
Spam emails try to get through filters by having slightly different content, such as writing “incredible” and “fantastic” interchangeably. For this, a template with all the possibilities is created and processed before sending. But sometimes unprocessed templates get sent instead. The writing is quite {incredible|fantastic|marvelous| outstanding}: {Say|Tell} No To {Fat|Being Fat}: {Act Now|Act Fast} & Get {Instant|Quick|Incredible| F....
|
|
On the last Golang Barcelona meetup we decided to try new format of conversation and after the talk started open discussion on logging, tracing and metrics. The idea was to encourage people to read a very nice blog post by Peter Bourgon on this subject - “Metrics, Tracing and Logging” and discuss it in a free format. It went surprisingly well, and while most of the people were conscious about the topic, one thing seemed to be still co..
|
|
On the last Golang Barcelona meetup we decided to try new format of conversation and after the talk started open discussion on logging, tracing and metrics. The idea was to encourage people to read a very nice blog post by Peter Bourgon on this subject - “Metrics, Tracing and Logging” and discuss it in a free format. It went surprisingly well, and while most of the people were conscious about the topic, one thing seemed to be still co..
|
|
Prelude This is the second post in a four part series that will provide an understanding of the mechanics and design behind pointers, stacks, heaps, escape analysis and value/pointer semantics in Go. This post focuses on heaps and escape analysis. Index of the four part series: Language Mechanics On Stacks And Pointers Language Mechanics On Escape Analysis Language Mechanics On Memory Profiling Design Philosophy On Data And Sema..
|
|
To celebrate 400+ visits to my blog after just 10 days (not bad, come on), I managed in my spare time to write another, very interesting article on another popular category of malware: keyloggers. -Continue to read the article on SerHack.me
|
|
Context Based on the scraped data, I’m planning on building an API, that’ll sync with the inventory management database (IMS). Things are still fuzzy in my head. Hopefully writing this down helps. As of now, these are the different parts of the application. Stage 1: READ ONLY (No API) IMS ——> Scraper ——> Postgres ——> Utility Scripts Stage 2: READ ONLY IMS ——> Scraper ——> Postgres ——> API Server ——> [Front Ends]
|
|
PostgreSQL 9.5.6 Documentation SQLAlchemy 1.1.10 Documentation SQLAlchemy with PostgreSQL Blog Post Context Mostly I’ve worked on scrapers/crawlers and scripts, and those usually don’t require a full blown database. Flat file and/or MongoDB are usually sufficient. However, now that I’m building a database web service for a client, I need to get familiar with a relational database. Requirements ¶ Using sqlalchemy with a postgre..
|
|
It feels like everyone is talking about platforms. Platform Thinking, Platform Strategies even the Platform Revolution. Platforms, it is argued, are the disruptive secret upon which a digital business is formed.
|
|
Recently I took the decision of leaving my long beloved distro – Ubuntu (sorry, link in spanish) and moving forward into Arch Linux. And why? As JFK said when the USA was aiming to land on the moon, “not because it’s easy, but because it’s hard”, maybe not that much compared to getting to the moon, but definitely more tedious than Ubuntu. One thing you can take for sure if you take the chance to install Arch: no matter if you success ....
|