Another parallel for us Robert. I love food metaphors. I grew up in a restaurant family. In fact, I've been thinking about the platforms I build as kitchens pretty much forever.
Given what you said above....food prep will take less time, we'll have nicer kitchens, people will eat better...does this create even more incentive for a high performing food supply chain? Reversing the metaphor and going back to data.....if LLMs are consuming data, do real time pipelines finally make sense?
Yeah! Thanks again for talking last week - all the metaphors are now quite actively swimming around in my brain. :)
That's a great point... Though a missing piece in the LLM world is that the data isn't actually being used/understood by the LLM (right now it's just schema context; not only b/c of technical limitations, but also because the OpenAI API is not SOC 2 compliant, so dumping data there would not be great). But definitely once we get there the pressure could be on to push for streaming. Will have a think and let you know if I have any other thoughts on this! What do you think?
Ok, so the notion that we convert observation into impact remains. Expanding that out into the typical knowledge people we have Measure>Gather>Prepare/Integrate>Think>Act.....repeat
This pipeline is a manufacturing processing with bottlenecks, like any pipeline. Sometimes its in the Gather/Prep step...data engineering. Sometimes its in the Think/Act phase....analytics engineering and analytics. If LLM makes Analytics and Analytics much easier and faster, then its no longer going to be the constraint. That moves the bottleneck to other parts of the pipeline
Another parallel for us Robert. I love food metaphors. I grew up in a restaurant family. In fact, I've been thinking about the platforms I build as kitchens pretty much forever.
Given what you said above....food prep will take less time, we'll have nicer kitchens, people will eat better...does this create even more incentive for a high performing food supply chain? Reversing the metaphor and going back to data.....if LLMs are consuming data, do real time pipelines finally make sense?
Yeah! Thanks again for talking last week - all the metaphors are now quite actively swimming around in my brain. :)
That's a great point... Though a missing piece in the LLM world is that the data isn't actually being used/understood by the LLM (right now it's just schema context; not only b/c of technical limitations, but also because the OpenAI API is not SOC 2 compliant, so dumping data there would not be great). But definitely once we get there the pressure could be on to push for streaming. Will have a think and let you know if I have any other thoughts on this! What do you think?
I think its equal part terrifying and exciting.
Ok, so the notion that we convert observation into impact remains. Expanding that out into the typical knowledge people we have Measure>Gather>Prepare/Integrate>Think>Act.....repeat
This pipeline is a manufacturing processing with bottlenecks, like any pipeline. Sometimes its in the Gather/Prep step...data engineering. Sometimes its in the Think/Act phase....analytics engineering and analytics. If LLM makes Analytics and Analytics much easier and faster, then its no longer going to be the constraint. That moves the bottleneck to other parts of the pipeline