Reverse Engineering - understanding Promises

Follow me on Twitter, happy to take your suggestions on topics or improvements /Chris

Here I am again with yet another article on reverse engineering. The idea, just like last time, is to be better at your craft. This time we are looking at Promises, an async construct that enables you to look at the code in a synchronous way. What is this sorcery you ask? Have a read and you'll find out

If you missed my first article on the topic, it's here and it's reverse engineering a unit testing library:

Reverse Engineering a Unit testing library

Back to this article. Promises. The approach we plan to take here is to have a look at the public API of the construct and try to make some educated guesses and then start implementing. We hope to gain some understanding of what goes on under the hood and hopefully smarten up in the process.

We will cover the following:

  • Why promises, this is one of the most important questions you need to ask yourself. Why am I learning/reading/using this?
  • What, what are core concepts of Promises
  • Implementation, we will be implementing a basic Promise but we will also support so-called chaining

Ready?

All right let's do this.

WHY

Because Promises are already part of the standard in both JavaScript for the Node.js and the Web means that the word promise is taken, sooo, what's a good synonym? Well, I just took the first thing my brain thought of which was swear, which took me all the way back to the year 1994.

Mobile/Cell phones looked like this:

MS-DOS was super popular, everyone was playing the game DOOM and mom was yelling at you for using the Internet when they were trying to use the phone.. 😉

Sweden scored a Bronze Medal in Football, for all the Brits, this was our 1966.

World Vup 94 - Sweden

Oh yea All-4-One was topping the charts with "I Swear"

World Vup 94 - Sweden

Yo, I'm here to hear about CODE old man

Yea, sorry. Ok. The great thing about Promises is that they let you arrange code in a way that it looks synchronous while remaining asynchronous.

Why is that good?

Consider the alternative callback hell, looking like this:

getData((data) => {
  getMoreData(data, (moreData) => {
    getEvenMoreData(moreData, (evenMoreData) => {
      console.log('actually do something')
    })
  })
})
1
2
3
4
5
6
7

3-levels you say, I can maybe live with that. Trust me you don't want to live with 3 or 11 levels. That's why we want Promises.

Ok ok, show me

With Promises you can write constructs such as this:

getData()
  .then(getMoreData)
  .then(geteEvenMoreData)
1
2
3

Seeing that for the first time I was like WOOOW, this changes, everything. I can actually read, line by line, what's happening, no weird tabulation or anything, just read it from the top.

Promises made it into the standard of Web and Node.js and we don't know what we would do without it.

## WHAT

Let's try to establish what we know about Promises so we can recreate it.

So with Promises, we have a way to wrap whatever asynchronous thing we do in a Promise construct like so:

const promise = new Promise((resolve, reject) => {
  setTimeout(() => {
    // do something 
    resolve('data')
  }, 2000)
})

promise
  .then(
    data => console.log(data)
    err => console.error(err)
  )
  
1
2
3
4
5
6
7
8
9
10
11
12
13

Above we can see that a Promise takes a factory function that has two parameters resolve and reject, which are both functions. When resolve is being invoked the first callback in the then() function is being called. Conversely when reject is being invoked the second callback in then is being called instead and logs it out as an error.

We also support something we've already shown, in the last section called chaining which is simply the following:

getData()
  .then(getMoreData)
  .then(geteEvenMoreData)
1
2
3

Looking at it from a code standpoint we can see that invoking then creates another Promise. We've so far mentioned that it's useful to look at the asynchronous code in a synchronous looking way but there is more.

Let's make the above example a bit more explicit by creating the functions we mentioned above

function getData() {
  return new Promise((resolve, reject) => {
    resolve('data')
  })
}

function getMoreData(data) {
  return new Promise((resolve, reject) => {
    resolve(data +' more data')
  })
}

function getEvenMoreData(data) {
  return new Promise((resolve, reject) => {
    resolve(data + ' even more data')
  })
}

function getMostData(data) {
  return data + "most";
}

getData()
  .then(getMoreData)
  .then(getEvenMoreData)
  .then(getMostData)
  .then(data => {
    console.log('printing', data)
  })

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30

The added strength to our chaining is that we can operate on the data we get back and send that right into the next function. So data can be sent in as a parameter to getMoreData() and the result of that can be sent into the next function and so on. Also, note how we above have a method called getMostData(), here we are not even constructing a new Promise but it's enough for us to just return something from the function and it's being resolved.

Let's mention one more thing before going to implementation, error handling. Now, we've actually shown error handling already:

const promise = new Promise((resolve, reject) => {
  setTimeout(() => {
    // do something 
    reject('error')
  }, 2000)
})

promise
  .then(
    data => console.log(data)
    err => console.error(err)
  )
1
2
3
4
5
6
7
8
9
10
11
12

Calling reject causes the second callback in then to be invoked. But there is more we could be use something called catch(). The idea of the catch() is to work as a catch-all method. Now, it's important to know how this works. If we already have an error callback on the then method, catch will not be invoked. So a construct like this wouldn't work as intended:

getData()
  .then(getMoreData, console.error)
  .then(getEvenMoreData)
  .catch(err => console.error)
1
2
3
4

What we want is most likely a scenario that works like this:

  1. do call
  2. if error, handle by local error handler
  3. after the error is handled locally, ensure we short circuit the flow

Implementation would then need to look like this:

getData()
  .then(getMoreData, (err) => {
    // handle error locally
    console.error(err);
    throw new Error(err);
  })
  .then(getEvenMoreData)
  .catch(err => console.error)
1
2
3
4
5
6
7
8

The above will work as intended if you mean to short circuit it. If you don't implement it like this, the chained promise will actually continue with getEvenMoreData.

That's enough context and insights in how Promises work. Let's try to implement them next.

Implementation

As I went through this exercise myself. I noticed there was more to Promises than meets the eye.

There's a lot to implementing a Promise

  • getting resolve/reject to work + then
  • chaining promises
  • error handling, both with local error handler but also the catch one
  • ensure we handle both the return of promises and simpler objects in a then callback

Given all of the above scenario might easily turn into a 20 min read piece I will try to implement enough to gain valuable insight.

Promises construction with resolve/reject

We said we would call it Swear once we started implementing it.

Ok then, building time. Let's look at the following construct and let's try to get it to work:

const promise = new Promise((resolve, reject) => {
  resolve('data')
  // reject('error')
})

promise
  then(data => console.log(data));
1
2
3
4
5
6
7

We can deduce the following from looking at it that:

  • Is a class, Promise is a class or at least a constructor function
  • Factory function input, Promise takes a factory function that has two input parameters resolve and reject.
  • resolve method should trigger then callback

From the above conclusions let's sketch:

// remember, Promise = Swear

class Swear {
  constructor(fn) {
    this.fn = fn;
  }

  _resolve(data) {
    this._fnSuccess(data);
  }

  then(fnSuccess) {
    this._fnSuccess = fnSuccess;
    this.fn(this._resolve.bind(this));
  }
}

const swear = new Swear((resolve) => {
  resolve('data');
})
  .then(data => {
    console.log('swear', data);
  })
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23

Running this is in the terminal we get:

Error callback

Ok, so far we've supported resolve() that is the success scenario in which we use the first callback in a then(). Now we are looking to support invoking reject() so the following should work:

new Swear((resolve, reject) => {
  reject('err')
})
1
2
3

We need to change the code in the following way to make it work:

class Swear {
  constructor(fn) {
    this.fn = fn;
  }

  _resolve(data) {
    this._fnSuccess(data);
  }

  _reject(err) {
    this._fnFailure(err);
  }

  then(fnSuccess) {
    this._fnSuccess = fnSuccess;
    this.fn(this._resolve.bind(this), this._reject.bind(this));
  }
}

const swear = new Swear((resolve) => {
  reject('error');
})
  .then(data => {
    console.log('swear', data);
  }, err => console.error(err))
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25

Running the above code you should get a response saying:

error error
1

Chaining

At this point we have a basic construct working. We did it or?

Well, we have ways to go. After this we should be supporting chaining meaning we should support that we could write code like this:

const swear = new Swear((resolve) => {
  resolve('data');
})
  .then(data => {
    console.log('swear', data);
    return 'test';
  })
  .then(data => {
    console.log(data)
  })
1
2
3
4
5
6
7
8
9
10

The whole idea with this construct is that we can take the response from one promise and reshape it into something else, like the above where turn data into test. How to support it though? From the above code we should be producing a Swear object when we call then() so let's add that part:

class Swear {
  constructor(fn) {
    this.fn = fn;
  }

  _resolve(data) {
    this._fnSuccess(data);
  }

  then(fnSuccess) {
    this._fnSuccess = fnSuccess;
    this.fn(this._resolve.bind(this));

    return new Swear((resolve) => {
      resolve(/* something */)
    })
  }
}
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18

Ok, we return the Swear instance at the end of then but we need to give it some data. Where do we get that data? Actually it comes from invoking this._fnSuccess, which we do in _resolve(). So let's add some code there:

class Swear {
  constructor(fn) {
    this.fn = fn;
  }

  _resolve(data) {
    this._data = this._fnSuccess(data);
  }

  then(fnSuccess) {
    this._fnSuccess = fnSuccess;
    this.fn(this._resolve.bind(this));

    return new Swear((resolve) => {
      resolve(this._data)
    })
  }
}

swear
.then(data => {
  console.log('swear', data);
  return 'test';
})
.then(data => {
  console.log(data);
})
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27

Let's try this code again:

We can see above that both of our .then() callbacks are being hit.

Implementing Catch

Catch have the following abilities:

  • catch an error, if no then error callbacks are specified
  • work in conjunction with error callbacks if there is an exception happening inside of a then callback.

Where to start? Well adding a catch() method is a good start

catch(fnCatch) {
  this._fnCatch = fnCatch;
}
1
2
3

Let's think for a second. It should only be called if no other error callbacks have dealt with an error. It should also have knowledge what the error was, regardless of where it happened in the Promise chain.

Looking at how Promise chains seems to work, errors doesn't seem to short-circuit the chain which means if we save the error and pass it on - we should be good. We should also consider having some kind of handled concept for when we handle an error.

Ok then, here is the implementation in all its glory:

class Swear {
  constructor(fn, error = null) {
    this.fn = fn;
    this.handled = false;
    this._error = error;
  }

  _resolve(data) {
    this._data = this._fnSuccess(data);
  }

  _reject(err) {
    this._error = err;
    if(this._fnFailure) {
      this._fnFailure(err);
      this.handled = true;
    }
  }

  then(fnSuccess, fnFailure) {
    this._fnSuccess = fnSuccess;
    this._fnFailure = fnFailure;
    this.fn(this._resolve.bind(this), this._reject.bind(this));

    return new Swear((resolve) => {
      resolve(this._data)
    }, !this.handled ? this._error : null)
  }

  catch(fnCatch) {
    this._fnCatch = fnCatch;
    if (!this.handled && this._error && this._fnCatch) {
      this._fnCatch(this._error);
    }
  }
}

const swear = new Swear((resolve, reject) => {
  reject('error');
})

swear
.then(data => {
  console.log('swear', data);
  return 'test';
} /*, err => console.error('Swear error',err)*/)
.then(data => {
  console.log(data);
})
.catch(err => console.error('Swear, catch all', err));
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50

As you can see from the above code, in the then() method, we pass the error to the next Promise in the chain IF it has NOT been handled.

return new Swear((resolve) => {
  resolve(this._data)
}, !this.handled ? this._error : null)
1
2
3

We consider an error handled if a local callback takes care of it, as shown in our _reject() method:

_reject(err) {
  this._error = err;
  if(this._fnFailure) {
    this._fnFailure(err);
    this.handled = true;
  }
}
1
2
3
4
5
6
7

Lastly, in our catch() method, we both receive a callback and invoke said callback, providing the error has NOT been handled, there is an error.

catch(fnCatch) {
  this._fnCatch = fnCatch;
  if (!this.handled && this._error && this._fnCatch) {
    this._fnCatch(this._error);
  }
}
1
2
3
4
5
6

We could problaby remove the _fnCatch() method and just call fnCatch directly.

Trying it out

The big question, does it work?

Well, lets try it out with a local callback and a catch method like so:

swear
.then(data => {
  console.log('swear', data);
  return 'test';
} , err => console.error('Swear error',err))
.then(data => {
  console.log(data);
})
.catch(err => console.error('Swear, catch all', err));
1
2
3
4
5
6
7
8
9

That looks like expected, our local error deals with it and our catch() method is never invoked.

What about no local handlers and just a catch() method?

swear
.then(data => {
  console.log('swear', data);
  return 'test';
})
.then(data => {
  console.log(data);
})
.catch(err => console.error('Swear, catch all', err));
1
2
3
4
5
6
7
8
9

Let's stop here.. Lots of insight already and let's not make this into a book.

Summary

In summary, we set out to implement part of a Promise and some abilities on it like resolve/reject, local error handlers, chaining, catch-all. We managed to do so in a few lines but we also realize there are things left to make this work well like being able to the success callback in then() when it returns a Promise/Swear, raising exceptions in that same callback or a failure callback, handling static methods such Promise.resolve, Promise.reject, Promise.all, Promise.any. Well you get the idea, this is not the end but merely the beginnning

I'm gonna leave you with these parting words from All-4-One

const swear = new Swear((resolve, reject) => {
  resolve('I swear');
})

swear
  .then(data => {
    return `${data}, by the Moon`
  })
  .then(data => {
    return `${data}, and the stars`
  })
  .then(data => {
    return `${data}, and the sun`
  })
  .then(data => console.log(data))
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15