Questions
8 of 24
Explain the concept of object streams and provide an example use case.
Difficulty: 5/10
objectMode, pipeline, back‑pressure
By default, Node.js streams deal with Buffer or string data, but object streams make it easier to handle structured data, such as JSON objects, arrays, or even complex custom objects.
To create or use an object stream, the objectMode property must be set to when creating a stream. This enables the stream to work with JavaScript objects rather than just bytes or characters.
Example Use Cases
- 1
Data Transformation Pipelines: Converting data formats (e.g., JSON to CSV). Normalizing data (e.g., modifying or restructuring object properties).
- 2
Logging Systems: Streaming log entries as structured objects for storage or analysis
- 3
Database Operations: Streaming objects from a database query and transforming or processing them before writing them to another source.
Scenario Questions
0-2 years experience
- 1How would you read a JSON file line by line using an object stream in Node.js?
- 2If you set `objectMode: true` on a readable stream, what type of data does it emit compared to the default mode?
- 3What happens if you pipe an object‑mode readable stream into a writable stream that expects Buffer data?
2-5 years experience
- 1You need to transform a stream of user objects to only include `id` and `email`. How would you implement this using Node.js streams, and what pitfalls might you watch for?
- 2During a deployment, the pipeline that processes incoming JSON messages started throwing `ERR_STREAM_WRITE_AFTER_END`. What could cause this in an object‑stream setup?
- 3Explain why using `stream.pipeline` is preferable to manually handling `error` events when chaining object streams.
5-8 years experience
- 1Design a high‑throughput log‑processing service that consumes JSON logs from a TCP socket, enriches them, and writes to a database. How would you leverage object streams, and what scaling concerns arise?
- 2When processing large CSV files as objects, you notice memory usage growing over time. What could be causing a memory leak in your object‑stream pipeline, and how would you mitigate it?
- 3Compare using object streams versus reading the whole file into memory for batch processing in terms of back‑pressure and fault tolerance.
8+ years experience
- 1Your organization wants to replace a monolithic ETL job that reads/writes JSON files with a streaming architecture across multiple microservices. What architectural changes and cross‑team considerations would you address when introducing object streams as the core data transport?
- 2How would you design a versioned schema evolution strategy for object streams that flow between services, ensuring backward compatibility without breaking existing consumers?
- 3Discuss the trade‑offs of using Node.js object streams versus a dedicated message broker like Kafka for inter‑service data pipelines at scale.
Follow-up Questions
- Can you sketch a minimal implementation of that pipeline?
- What would you monitor in production to ensure the stream stays healthy?
- How would you test error handling in an object‑mode pipeline?