Much larger images can be supported. This may be of interest: <http://lists.squeakfoundation.org/pipermail/vm-dev/2010-November/005731.html> In practical use, the current garbage collector will probably be the limiting factor. Dave On Thu, Nov 24, 2011 at 01:29:26PM -0300, Alexandre Bergel wrote:
As Stefan put it, the current system forces us to make early decisions, which are likely to be wrong on some point.
Since there is no other option, we are thinking very hard on what do we really need. We are implementing ad-hoc caching as you suggested, but this clearly puts some strong constraints on what can be done.
Alexandre
On 24 Nov 2011, at 13:13, Igor Stasenko wrote:
I think you looking for solution in a wrong direction. Just ask yourself, how much of that data you need to keep in operative memory at single moment of time to efficiently compute results. If today you need to deal with >500Mb data sets, tomorrow you may need to deal with multigigabyte datasets, which can easily surpass the amount of operative memory your computer has.
I know, it is easier to find cheap solution, without spending time implementing own data caching scheme, but you just delaying inevitable.
With things like Fuel, i think it won't take too much effort to do it.
On 24 November 2011 14:06, Alexandre Bergel <alexandre.bergel@me.com> wrote:
But, I also guess that Alex refers to the default values for memory when running the VM. Is that correct Alex?
Yes.
Alexandre
On 24 Nov 2011, at 07:27, Francois Stephany wrote:
I'm wondering: how big is a dataset > 500MB ? I've no idea how big it is. Alex, what is your use case (in practice!) for more than 500MB?
On 23/11/11 18:25, Igor Stasenko wrote:
It is problematic, and requires different memory management than we currently have. I think if you need really big data sets, then use gemstone, which is developed to deal with that specifically.
-- www.tudorgirba.com
"Speaking louder won't make the point worthier."
-- Best regards, Igor Stasenko.
-- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.