Read stories from our Forward Deployed Engineers.

Engineering Blog

Trusted by platform engineering teams

Latest

All Posts

Measure Once — Export Anywhere: OpenCensus in the wild
By Aviv LauferMar 20, 20182 min read

Measure Once — Export Anywhere: OpenCensus in the wild

A few months ago, Google has announced OpenCensus, a vendor-neutral open source library for telemetry and tracing collection. OpenCensus makes it easy to collect metrics from your app and to trace the progression or requests.

Reduce Google Compute Engine costs by 60% with Zorya — GCE Instance Scheduler
By Aviv LauferFeb 26, 20186 min read

Reduce Google Compute Engine costs by 60% with Zorya — GCE Instance Scheduler

Running non-production environments in the cloud is great. They are conveniently available to you at any time, right when you need them. But this convenience sometimes comes with a price tag.

Autoscaling Google Dataproc Clusters
By Aviv LauferFeb 5, 20186 min read

Autoscaling Google Dataproc Clusters

Cloud Dataproc is an amazingly fast to provision, easy-to-use, fully-managed cloud service for running Apache Spark and Apache Hadoop clusters in a simple and very cost-efficient way.

Analyzing Israeli weed market with Google Cloud DataPrep, BigQuery and TensorFlow
By Aviv LauferJan 8, 20186 min read

Analyzing Israeli weed market with Google Cloud DataPrep, BigQuery and TensorFlow

Let’s start with a short disclaimer — DoiT International does not promote, condone or advocate licit or illicit drug use.

Visualizing BigQuery jobs with Stackdriver, Cloud Functions, Firebase and Pub/Sub
By Aviv LauferNov 8, 20174 min read

Visualizing BigQuery jobs with Stackdriver, Cloud Functions, Firebase and Pub/Sub

At DoiT International, we are using Google BigQuery quite extensively as a data analytics platform for reOptimize — our free cost optimization platform for Google Cloud Platform.

How to predict your Google Cloud Platform monthly bill with Google CloudML & BigQuery
By Vadim SoloveyAug 29, 20179 min read

How to predict your Google Cloud Platform monthly bill with Google CloudML & BigQuery

As some of you might already know, DoiT International is the engineering power behind reOptimize — Cost Discovery and Optimization SaaS for Google Cloud Platform.

How we saved over $240K per year by replacing Mixpanel with BigQuery, Dataflow & Kubernetes
By Vadim SoloveyAug 14, 20175 min read

How we saved over $240K per year by replacing Mixpanel with BigQuery, Dataflow & Kubernetes

Traditionally, a lot of companies rely on Mixpanel for product analytics to understand each user’s journey. However, if your product becomes a success and your volume of events is getting high, Mixpanel may become somewhat expensive. In this post we are going to review one of our projects with Jelly Button to design their own event-analytics solution based on Google Cloud Platform in a very efficient way and which is going to save Jelly Button about quarter million dollars each year.

Multi-Cloud Engineering Meetup — The first half of 2017 in review
By Vadim SoloveyJul 2, 20174 min read

Multi-Cloud Engineering Meetup — The first half of 2017 in review

The 2nd quarter of 2017 is over and now it’s time to summarize the Multi-Cloud Engineering Meetup group for the first half of the year.

gSlack: Integrating Google Cloud Platform with Slack
By Vadim SoloveyJun 28, 20175 min read

gSlack: Integrating Google Cloud Platform with Slack

One of the perks I really like as part of my work as CTO at DoiT International, is my day-to-day conversations with our customers. On many occasions, they are enlightening and I always learn something new.

Google BigQuery Benchmark
By Vadim SoloveyJun 8, 20154 min read

Google BigQuery Benchmark

Recently, I came across an interesting benchmark of BigData systems based on “A Comparison of Approaches to Large-Scale Data Analysis” by Pavlo et al. (SIGMOD 2009). Based on the benchmark methodology, the APMLab guys from Berkeley University developed an open-source software that allows anyone to run this benchmark using public cloud (AWS in this case).