microservicios, en qué lío me he metido

9 y 10 de febrero#T3chFest2017



Microservcios, en qué lío me he metido.

Ernesto HernándezPacklink

Miguel OrtegaPacklink


LabelsTrackingPayments: Credit card, Paypal, DeferredInvoicingE-commerces integrationAutocomplete rulesZip codes

NOT JUST A SIMPLE CARRIER COMPARATOR


● 7 Countries

● Over 50 carriers

● >300 shipping services

● >500% shipment grow

● >2M shipments/year


http://transformcustomers.com/category/business-transformation/ 9 y 10 de febrero#T3chFest2017


Our legacy old

Monolith

http://isijisan.blogspot.com.es/2015/03/el-escarabajo-pelotero.html


Fast growth


Our shiny and new

Monolith

https://mekubal.wordpress.com/2012/04/03/the-myth-of-monolithic-judaism/

KOKUDO


Our Monoliths

KOKUDO


Business needs!!! We need an API

9 y 10 de febrero#T3chFest2017Sometimes you need to clean up


● Another monolith

● ESB orchestration

● DB coupling

● Fixed deploy dates

● Something distributed

● More choreography

● Different storages

● Deploy flexibility


It seems clear right?

Microservices


2014 2015 2016

9 y 10 de febrero#T3chFest2017but what the hell is a microservice?

CHALLENGE ACCEPTED


Phase 1


Phase 2


● ONE DATABASE● STILL A MONOLITH

FATAL


Phase 3



● NO REAL MICROSERVICES● DEPLOY/CONFIGURATION HELL

ERROR


Turn

Around


Phase 4



Synchronous calls

Network call


Phase 4



● SYNCHRONOUS CALLS HELL● WHERE ARE MY JOINS?

warning


Asynchronous

MESSAGE BUS


Phase 5



Event Driven ArchitectureApps generates events when an action occurs.

Events are published to a message bus

Events represent things that happened in our apps like “client.created”

Other apps can react to this events with other actions or creating materialized views


New apps can only receive events since the time that was introduced in our platform

Materialized view for the new microservice it’s not complete

What about a new microservice ?


Event store

Apps events are stored in an event log


Event store


Events are appended at the end of the log


If a new service is added to the platform, it`s materialized view can be recreated with the past events

Event store - adding a new app


Events are appended at the end of the log


Benefits

• Materialized views

• Rebuild app state

• Stream processing

• CEP


“Distributed transactions”

• Avoid 2 phase commit !!!

• Do compensating

transactions instead


Event Sourcing

https://martinfowler.com/articles/201701-event-driven.html

http://microservices.io/patterns/data/event-driven-architecture.html


The Platform


Docker Ecosystem FTW

● build once, run everywhere

● easy scaling with docker-compose

● infrastructure scaling with swarm


Hashicorp Consul

- Key/Value (backed by git repo)

- consul-template

- Leader election

- DNS

- Already needed for docker swarm



Service discovery



How do I develop locally?



New old problems

● Onboarding new developers

● Config management

● Debugging

● Data Bootstrapping


What do we need?

● Infrastructure Bootstrapping:

○ up and running

○ configuration

● Microservices Bootstrapping:

○ up and running

○ application data


How do we solved it?

● Infrastructure Bootstrapping.

○ up and running

○ configuration

● Microservices Bootstrapping:

○ up and running

○ application data



Platform versioning

• microservices.yml - v 2.1.4• search-engine v 2.3.1

• client v 4.2.3

• infrastructure.yml - v 2.1.4• percona v 5.6

• rabbitmq v 3.5

• config repo - v 2.1.4

Packlink v 2.1.4


Local development


Service discovery (review)



Local development with your IDE



Tunnel



Service discovery (all together)



● DUDE, WHERE ARE MY LOGS?

DEBUG


Logging stack


Correlation id

Network call{ correlation_id: 123, ... }

{ correlation_id: 123, ... }{ correlation_id: 123, ... }

{ correlation_id: 123, ... }




● Make your application log-aggregator agnostic

FATAL


● How do I trace a single request?

TRACE


Distributed tracing


Our (helpful) Dev Tools


https://slack.com


Wiggumbot

https://wiki.jenkins-ci.org/display/JENKINS/GitHub+pull+request+builder+pluginhttp://docs.sonarqube.org/display/PLUG/GitHub+Plugin9 y 10 de febrero

#T3chFest2017

(Our personal code-reviewer guardian)


Hound

https://github.com/etsy/hound

Etsy, Inc.



Asciidoctor

http://asciidoctor.org9 y 10 de febrero#T3chFest2017


Was it worth it?



# Shipments


# Deployments

2 → ~20 per week


Thank you



It seems clear right?

Q&A



WE ARE HIRING

microservicios, en qué lío me he metido

Software