- Pharo-users - lists.pharo.org

Re: [Pharo-users] [Bulk] Trouble opening large files

by Yanni Chiu

On Oct 15, 2014, at 1:02 AM, Evan Donahue <emdonahu(a)gmail.com> wrote: > > I am processing natural language statistics over the entire wiki corpus, not querying for specific entries. The information and entries aren't important so much as the raw quantity of words. A simple stream through a file on disk is all I need. Maybe you can workaround the problem by writing a shell script that writes the file over a pipe or socket. Then on the that Pharo side, connect to the pipe/socket, and read the data stream.

Oct. 15, 2014

Re: [Pharo-users] Trouble opening large files

by Evan Donahue

Certainly, thanks for the curiosity. I am processing natural language statistics over the entire wiki corpus, not querying for specific entries. The information and entries aren't important so much as the raw quantity of words. A simple stream through a file on disk is all I need. Thanks, Evan On Wed, Oct 15, 2014 at 12:49 AM, HernÃ¡n Morales Durand < hernan.morales(a)gmail.com> wrote: > > > 2014-10-13 21:27 GMT-03:00 Evan Donahue <emdonahu(a)gmail.com>: > >> Hello, I've run into some odd behavior and wanted to check whether I >> might be missing something: >> >> I have downloaded a copy of the english wikipedia as an xml file and am >> hoping to (sax) parse it. However, I can't even seem to get pharo to >> recognize that the file exists. >> >> > Just for curiosity's sake, is there a reason why you don't query through a > Sparql to dbpedia? > > Cheers, > > HernÃ¡n > > >

Oct. 15, 2014

Re: [Pharo-users] Trouble opening large files

by HernÃ¡n Morales Durand

2014-10-13 21:27 GMT-03:00 Evan Donahue <emdonahu(a)gmail.com>: > Hello, I've run into some odd behavior and wanted to check whether I might > be missing something: > > I have downloaded a copy of the english wikipedia as an xml file and am > hoping to (sax) parse it. However, I can't even seem to get pharo to > recognize that the file exists. > > Just for curiosity's sake, is there a reason why you don't query through a Sparql to dbpedia? Cheers, HernÃ¡n

Oct. 15, 2014

Re: [Pharo-users] Copy/past doesn't work sometimes in Chrome semifixed

by Peter UhnÃ¡k

I think I found a solution. But first the problem, which preferably would be fixed in the Pharo VM but I have no idea how to contribute there or if this is actually correct/wrong: After a lot of debugging and trying to figure out why paste from Google Chrome(ium) isn't working in Linux I found out that the default encoding isn't unicode. According to this the default should be UTF-8 platforms/unix/vm/sqUnixMain.c:1493 printf(" --textenc <enc> set encoding for external text (default: UTF-8)\n"); however by default it is set to 0 platforms/unix/vm/sqUnixMain.c:127 int textEncodingUTF8= 0; /* 1 if copy from external selection uses UTF8 */ and only set to 1 if it is explicitly provided (--textenc UTF-8) platforms/unix/vm/sqUnixMain.c:1452 else if (!strcmp(argv[0], "--textenc")) { char *buf= (char *)malloc(strlen(argv[1]) + 1); int len, i; strcpy(buf, argv[1]); len= strlen(buf); for (i= 0; i < len; ++i) buf[i]= toupper(buf[i]); if ((!strcmp(buf, "UTF8")) || (!strcmp(buf, "UTF-8"))) textEncodingUTF8= 1; else setEncoding(&uxTextEncoding, buf); free(buf); return 2; } -- So the (temporary) fix is quite simple: specify the --textenc encoding when launching Pharo. :) Peter On Thu, Jul 31, 2014 at 12:38 PM, Julien Delplanque <julien(a)tamere.eu> wrote: > Ok, so I'll have to get used to it or switch to another web browser > while using pharo. > > Thanks for your answers. > > On 31/07/14 10:44, Peter UhnÃ¡k wrote: > > It seems that the Chromium issue is most likely a result of them > switching > > from GTK to Aura, since it broke in version 35 (when Aura was > introduced). > > So unless someone wants to dive into Pharo VM or Chromium then there is > > really no simple solution. > > > > > > On Wed, Jul 30, 2014 at 9:10 PM, Peter UhnÃ¡k <i.uhnak(a)gmail.com> wrote: > > > >> Today I found out that if I have running xclipboard in the background > >> pasting works properly even from Chromium. The problem is that it's a > GUI > >> app and will store everything that I've copied unless manually deleted. > But > >> you can give it a shot. Haven't really tested how it deals with non-text > >> content (images). > >> Also I tried to dig a little bit into how it is handled inside Pharo, > but > >> it is somewhere deep in VM. :( > >> However middle-click pasting doesn't work but that seem to be simply a > >> limitation of Pharo (My guess is because it is only supported by Linux > and > >> not Windows/Mac?). > >> > >> > >> On Tue, Jul 29, 2014 at 9:42 PM, Julien Delplanque <julien(a)tamere.eu> > >> wrote: > >> > >>> I also notice the problem when I copy something from my terminal > >>> ("drop-down terminal" or "terminator" on Gnome3) to pharo IDE. > >>> > >>> Very annoying to copy text from Chromium to Sublime text and then > recopy > >>> it from Sublime text to Pharo IDE even if (sadly) it became a habit... > >>> > >>> On 29/07/14 20:10, Peter UhnÃ¡k wrote: > >>>> I have the same problem on Debian, on both Pharo 3 and 4. > >>>> I think that Chromium is doing something weird when copying to > >>> clipboard, > >>>> because every other program I've tried works just fine. > >>>> As a workaround I've installed clipboard manager and I copy from there > >>> (or > >>>> paste and re-copy in some other text editor currently opened). > >>>> > >>>> Linux has multiple clipboards (at least one when copying text and one > >>> for > >>>> currently selected text), so maybe Chromium uses the wrong one, or > >>> Pharo is > >>>> checking only one? > >>>> > >>>> Peter > >>>> > >>>> > >>>> On Tue, Jul 29, 2014 at 5:06 PM, Julien Delplanque <julien(a)tamere.eu> > >>> wrote: > >>>>> Hello, > >>>>> > >>>>> I'm using pharo 3.9-7 and I notice that sometimes the copy/past > >>> function > >>>>> from another program to the pharo IDE doesn't work. > >>>>> > >>>>> For example, if I copy something from my internet browser (Chromium) > to > >>>>> a workspace in the IDE it doesn't work. > >>>>> > >>>>> I also notice that if I copy something from my text editor (Sublime > >>>>> text) to a workspace it works... > >>>>> > >>>>> ArchLinux version: > >>>>> > >>>>> Linux msi 3.15.5-2-ARCH #1 SMP PREEMPT Fri Jul 11 07:56:02 CEST 2014 > >>>>> x86_64 GNU/Linux > >>>>> > >>>>> My Pharo VM version: > >>>>> > >>>>> 3.9-7 #1 Thu May 15 18:29:30 CEST 2014 gcc 4.6.3 [Production ITHB VM] > >>>>> NBCoInterpreter NativeBoost-CogPlugin-GuillermoPolito.19 uuid: > >>>>> acc98e51-2fba-4841-a965-2975997bba66 May 15 2014 > >>>>> NBCogit NativeBoost-CogPlugin-GuillermoPolito.19 uuid: > >>>>> acc98e51-2fba-4841-a965-2975997bba66 May 15 2014 > >>>>> https://github.com/pharo-project/pharo-vm.git Commit: > >>>>> ed4a4f59208968a21d82fd2406f75c2c4de558b2 Date: 2014-05-15 18:23:04 > >>> +0200 > >>>>> By: Esteban Lorenzano <estebanlm(a)gmail.com> Jenkins build #14826 > >>>>> Linux pharo-linux 3.2.0-31-generic-pae #50-Ubuntu SMP Fri Sep 7 > >>> 16:39:45 > >>>>> UTC 2012 i686 i686 i386 GNU/Linux > >>>>> > >>>>> Thank you in advance for your responses! > >>>>> > >>>>> Julien > >>>>> > >>>>> > >>> > >>> > > >

Oct. 14, 2014

Re: [Pharo-users] Trouble opening large files

by Nicolai Hess

Easiest way: download the generated source from http://files.pharo.org/vm/src/vm-unix-sources/blessed/ 2014-10-14 22:35 GMT+02:00 Evan Donahue <emdonahu(a)gmail.com>: > 64 bits! That makes sense. I don't generally work with large files either. > I have been getting my vm from get.pharo.org, so I will need to get the > source to build the vm in the first place. A quick survey over the last few > hours has revealed a multitude of vms, projects, platforms, repositories, > and versions that I, in my pharo ignorance, cannot differentiate. Could > someone please point me to the source I should be using to build the vm for > the pharo40 image I have been pulling of get.pharo.org? > > Thank you, > Evan > > On Tue, Oct 14, 2014 at 3:02 PM, Nicolai Hess <nicolaihess(a)web.de> wrote: > >> Rebuild pharo vm with D_FILE_OFFSET_BITS=64 option: >> Reading list directories with (very) large files working now. >> >> >> >> 2014-10-14 20:26 GMT+02:00 Nicolai Hess <nicolaihess(a)web.de>: >> >>> There is a bug report on mantis for squeaks unix vm. >>> I think this applies to pharo too, although I don't know if this >>> bug is still valid on recent squeak vm. >>> >>> http://bugs.squeak.org/view.php?id=7522 >>> >>> 2014-10-14 17:43 GMT+02:00 Evan Donahue <emdonahu(a)gmail.com>: >>> >>>> The OS is Arch Linux. >>>> >>>> I can read the file with less. >>>> >>>> The problem, insofar as I can trace it, seems to stem from this line in >>>> UnixStore: >>>> >>>> Primitives lookupDirectory: encodedPath filename: encodedBasename >>>> >>>> When I have my 57G file there this line returns nil. If I move the 57G >>>> file and create a small file with the same name, the same command >>>> successfully finds the file. I am not sure how large a file must be to >>>> cause this issue, but A 1.5G file works fine. >>>> >>>> On Tue, Oct 14, 2014 at 8:17 AM, Nicolai Hess <nicolaihess(a)web.de> >>>> wrote: >>>> >>>>> 2014-10-14 6:38 GMT+02:00 Evan Donahue <emdonahu(a)gmail.com>: >>>>> >>>>>> Hi, thanks for the reply. >>>>>> >>>>>> The response is the same: "MessageNotUnderstood: >>>>>> False>>humanReadableSIByteSize." >>>>>> >>>>>> This happens both to print-it as well as to do-it-and-go. Running the >>>>>> command on the neighboring "wiki.torrent" torrent file yields the correct >>>>>> 54kb. >>>>>> >>>>>> Thanks, >>>>>> Evan >>>>>> >>>>>> On Tue, Oct 14, 2014 at 12:24 AM, Tudor Girba <tudor(a)tudorgirba.com> >>>>>> wrote: >>>>>> >>>>>>> Hi, >>>>>>> >>>>>>> If I understand correctly, the failure occurs while navigating in >>>>>>> the "Items" presentation. >>>>>>> >>>>>>> I cannot reproduce this problem because I do not have enough disk >>>>>>> space for such a large file :). But, could you do the following and let me >>>>>>> know what the outcome is: >>>>>>> >>>>>>> 'path/to/your/large/file.xml' asFileReference humanReadableSize >>>>>>> >>>>>>> ? >>>>>>> >>>>>>> Cheers, >>>>>>> Doru >>>>>>> >>>>>>> >>>>>>> >>>>>>> On Tue, Oct 14, 2014 at 2:27 AM, Evan Donahue <emdonahu(a)gmail.com> >>>>>>> wrote: >>>>>>> >>>>>>>> Hello, I've run into some odd behavior and wanted to check whether >>>>>>>> I might be missing something: >>>>>>>> >>>>>>>> I have downloaded a copy of the english wikipedia as an xml file >>>>>>>> and am hoping to (sax) parse it. However, I can't even seem to get pharo to >>>>>>>> recognize that the file exists. >>>>>>>> >>>>>>>> If I open FileSystem disk root in the playground and naigate, >>>>>>>> attempting to enter the folder containing the (57G) xml file fails with >>>>>>>> "MessageNotUnderstood: False>>humanReadableSIByteSize." Likewise if I get a >>>>>>>> FileReference with FileSystem disk root / 'path' / 'to' / 'file' then self >>>>>>>> exists returns false and the parser fails. >>>>>>>> >>>>>>>> Am I doing something wrong? Should I be able to do this? >>>>>>>> >>>>>>>> The version number is #40283 >>>>>>>> >>>>>>>> Thanks, >>>>>>>> Evan >>>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> www.tudorgirba.com >>>>>>> >>>>>>> "Every thing has its own flow" >>>>>>> >>>>>> >>>>>> >>>>> >>>>> Which OS ? >>>>> Can you check with other programs if this file is readable at all? >>>>> >>>>> >>>>> >>>>> >>>>> Nicolai >>>>> >>>>> >>>>> >>>> >>> >> >

Oct. 14, 2014

Re: [Pharo-users] Trouble opening large files

by Evan Donahue

64 bits! That makes sense. I don't generally work with large files either. I have been getting my vm from get.pharo.org, so I will need to get the source to build the vm in the first place. A quick survey over the last few hours has revealed a multitude of vms, projects, platforms, repositories, and versions that I, in my pharo ignorance, cannot differentiate. Could someone please point me to the source I should be using to build the vm for the pharo40 image I have been pulling of get.pharo.org? Thank you, Evan On Tue, Oct 14, 2014 at 3:02 PM, Nicolai Hess <nicolaihess(a)web.de> wrote: > Rebuild pharo vm with D_FILE_OFFSET_BITS=64 option: > Reading list directories with (very) large files working now. > > > > 2014-10-14 20:26 GMT+02:00 Nicolai Hess <nicolaihess(a)web.de>: > >> There is a bug report on mantis for squeaks unix vm. >> I think this applies to pharo too, although I don't know if this >> bug is still valid on recent squeak vm. >> >> http://bugs.squeak.org/view.php?id=7522 >> >> 2014-10-14 17:43 GMT+02:00 Evan Donahue <emdonahu(a)gmail.com>: >> >>> The OS is Arch Linux. >>> >>> I can read the file with less. >>> >>> The problem, insofar as I can trace it, seems to stem from this line in >>> UnixStore: >>> >>> Primitives lookupDirectory: encodedPath filename: encodedBasename >>> >>> When I have my 57G file there this line returns nil. If I move the 57G >>> file and create a small file with the same name, the same command >>> successfully finds the file. I am not sure how large a file must be to >>> cause this issue, but A 1.5G file works fine. >>> >>> On Tue, Oct 14, 2014 at 8:17 AM, Nicolai Hess <nicolaihess(a)web.de> >>> wrote: >>> >>>> 2014-10-14 6:38 GMT+02:00 Evan Donahue <emdonahu(a)gmail.com>: >>>> >>>>> Hi, thanks for the reply. >>>>> >>>>> The response is the same: "MessageNotUnderstood: >>>>> False>>humanReadableSIByteSize." >>>>> >>>>> This happens both to print-it as well as to do-it-and-go. Running the >>>>> command on the neighboring "wiki.torrent" torrent file yields the correct >>>>> 54kb. >>>>> >>>>> Thanks, >>>>> Evan >>>>> >>>>> On Tue, Oct 14, 2014 at 12:24 AM, Tudor Girba <tudor(a)tudorgirba.com> >>>>> wrote: >>>>> >>>>>> Hi, >>>>>> >>>>>> If I understand correctly, the failure occurs while navigating in the >>>>>> "Items" presentation. >>>>>> >>>>>> I cannot reproduce this problem because I do not have enough disk >>>>>> space for such a large file :). But, could you do the following and let me >>>>>> know what the outcome is: >>>>>> >>>>>> 'path/to/your/large/file.xml' asFileReference humanReadableSize >>>>>> >>>>>> ? >>>>>> >>>>>> Cheers, >>>>>> Doru >>>>>> >>>>>> >>>>>> >>>>>> On Tue, Oct 14, 2014 at 2:27 AM, Evan Donahue <emdonahu(a)gmail.com> >>>>>> wrote: >>>>>> >>>>>>> Hello, I've run into some odd behavior and wanted to check whether I >>>>>>> might be missing something: >>>>>>> >>>>>>> I have downloaded a copy of the english wikipedia as an xml file and >>>>>>> am hoping to (sax) parse it. However, I can't even seem to get pharo to >>>>>>> recognize that the file exists. >>>>>>> >>>>>>> If I open FileSystem disk root in the playground and naigate, >>>>>>> attempting to enter the folder containing the (57G) xml file fails with >>>>>>> "MessageNotUnderstood: False>>humanReadableSIByteSize." Likewise if I get a >>>>>>> FileReference with FileSystem disk root / 'path' / 'to' / 'file' then self >>>>>>> exists returns false and the parser fails. >>>>>>> >>>>>>> Am I doing something wrong? Should I be able to do this? >>>>>>> >>>>>>> The version number is #40283 >>>>>>> >>>>>>> Thanks, >>>>>>> Evan >>>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> www.tudorgirba.com >>>>>> >>>>>> "Every thing has its own flow" >>>>>> >>>>> >>>>> >>>> >>>> Which OS ? >>>> Can you check with other programs if this file is readable at all? >>>> >>>> >>>> >>>> >>>> Nicolai >>>> >>>> >>>> >>> >> >

Oct. 14, 2014

Re: [Pharo-users] Trouble opening large files

by Nicolai Hess

Rebuild pharo vm with D_FILE_OFFSET_BITS=64 option: Reading list directories with (very) large files working now. 2014-10-14 20:26 GMT+02:00 Nicolai Hess <nicolaihess(a)web.de>: > There is a bug report on mantis for squeaks unix vm. > I think this applies to pharo too, although I don't know if this > bug is still valid on recent squeak vm. > > http://bugs.squeak.org/view.php?id=7522 > > 2014-10-14 17:43 GMT+02:00 Evan Donahue <emdonahu(a)gmail.com>: > >> The OS is Arch Linux. >> >> I can read the file with less. >> >> The problem, insofar as I can trace it, seems to stem from this line in >> UnixStore: >> >> Primitives lookupDirectory: encodedPath filename: encodedBasename >> >> When I have my 57G file there this line returns nil. If I move the 57G >> file and create a small file with the same name, the same command >> successfully finds the file. I am not sure how large a file must be to >> cause this issue, but A 1.5G file works fine. >> >> On Tue, Oct 14, 2014 at 8:17 AM, Nicolai Hess <nicolaihess(a)web.de> wrote: >> >>> 2014-10-14 6:38 GMT+02:00 Evan Donahue <emdonahu(a)gmail.com>: >>> >>>> Hi, thanks for the reply. >>>> >>>> The response is the same: "MessageNotUnderstood: >>>> False>>humanReadableSIByteSize." >>>> >>>> This happens both to print-it as well as to do-it-and-go. Running the >>>> command on the neighboring "wiki.torrent" torrent file yields the correct >>>> 54kb. >>>> >>>> Thanks, >>>> Evan >>>> >>>> On Tue, Oct 14, 2014 at 12:24 AM, Tudor Girba <tudor(a)tudorgirba.com> >>>> wrote: >>>> >>>>> Hi, >>>>> >>>>> If I understand correctly, the failure occurs while navigating in the >>>>> "Items" presentation. >>>>> >>>>> I cannot reproduce this problem because I do not have enough disk >>>>> space for such a large file :). But, could you do the following and let me >>>>> know what the outcome is: >>>>> >>>>> 'path/to/your/large/file.xml' asFileReference humanReadableSize >>>>> >>>>> ? >>>>> >>>>> Cheers, >>>>> Doru >>>>> >>>>> >>>>> >>>>> On Tue, Oct 14, 2014 at 2:27 AM, Evan Donahue <emdonahu(a)gmail.com> >>>>> wrote: >>>>> >>>>>> Hello, I've run into some odd behavior and wanted to check whether I >>>>>> might be missing something: >>>>>> >>>>>> I have downloaded a copy of the english wikipedia as an xml file and >>>>>> am hoping to (sax) parse it. However, I can't even seem to get pharo to >>>>>> recognize that the file exists. >>>>>> >>>>>> If I open FileSystem disk root in the playground and naigate, >>>>>> attempting to enter the folder containing the (57G) xml file fails with >>>>>> "MessageNotUnderstood: False>>humanReadableSIByteSize." Likewise if I get a >>>>>> FileReference with FileSystem disk root / 'path' / 'to' / 'file' then self >>>>>> exists returns false and the parser fails. >>>>>> >>>>>> Am I doing something wrong? Should I be able to do this? >>>>>> >>>>>> The version number is #40283 >>>>>> >>>>>> Thanks, >>>>>> Evan >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> www.tudorgirba.com >>>>> >>>>> "Every thing has its own flow" >>>>> >>>> >>>> >>> >>> Which OS ? >>> Can you check with other programs if this file is readable at all? >>> >>> >>> >>> >>> Nicolai >>> >>> >>> >> >

Oct. 14, 2014

Re: [Pharo-users] [squeak-dev] Re: Trouble opening large files

by Eliot Miranda

Hi Nicolai, On Tue, Oct 14, 2014 at 11:26 AM, Nicolai Hess <nicolaihess(a)web.de> wrote: > There is a bug report on mantis for squeaks unix vm. > I think this applies to pharo too, although I don't know if this > bug is still valid on recent squeak vm. > > http://bugs.squeak.org/view.php?id=7522 > yes, one must compile with -D_FILE_OFFSET_BITS=64. The Cog VMs are also built with -D_GNU_SOURCE. Here's a line from a Squeak file list on the current Cog VM: (2014.10.11 07:00:46 7,115,143,880) Formula1.2014.Round16.Russia.Qualifying.BBCOneHD.1080i.H264.English-wserhkzt.ts No 32-bit limit here. > > 2014-10-14 17:43 GMT+02:00 Evan Donahue <emdonahu(a)gmail.com>: > >> The OS is Arch Linux. >> >> I can read the file with less. >> >> The problem, insofar as I can trace it, seems to stem from this line in >> UnixStore: >> >> Primitives lookupDirectory: encodedPath filename: encodedBasename >> >> When I have my 57G file there this line returns nil. If I move the 57G >> file and create a small file with the same name, the same command >> successfully finds the file. I am not sure how large a file must be to >> cause this issue, but A 1.5G file works fine. >> >> On Tue, Oct 14, 2014 at 8:17 AM, Nicolai Hess <nicolaihess(a)web.de> wrote: >> >>> 2014-10-14 6:38 GMT+02:00 Evan Donahue <emdonahu(a)gmail.com>: >>> >>>> Hi, thanks for the reply. >>>> >>>> The response is the same: "MessageNotUnderstood: >>>> False>>humanReadableSIByteSize." >>>> >>>> This happens both to print-it as well as to do-it-and-go. Running the >>>> command on the neighboring "wiki.torrent" torrent file yields the correct >>>> 54kb. >>>> >>>> Thanks, >>>> Evan >>>> >>>> On Tue, Oct 14, 2014 at 12:24 AM, Tudor Girba <tudor(a)tudorgirba.com> >>>> wrote: >>>> >>>>> Hi, >>>>> >>>>> If I understand correctly, the failure occurs while navigating in the >>>>> "Items" presentation. >>>>> >>>>> I cannot reproduce this problem because I do not have enough disk >>>>> space for such a large file :). But, could you do the following and let me >>>>> know what the outcome is: >>>>> >>>>> 'path/to/your/large/file.xml' asFileReference humanReadableSize >>>>> >>>>> ? >>>>> >>>>> Cheers, >>>>> Doru >>>>> >>>>> >>>>> >>>>> On Tue, Oct 14, 2014 at 2:27 AM, Evan Donahue <emdonahu(a)gmail.com> >>>>> wrote: >>>>> >>>>>> Hello, I've run into some odd behavior and wanted to check whether I >>>>>> might be missing something: >>>>>> >>>>>> I have downloaded a copy of the english wikipedia as an xml file and >>>>>> am hoping to (sax) parse it. However, I can't even seem to get pharo to >>>>>> recognize that the file exists. >>>>>> >>>>>> If I open FileSystem disk root in the playground and naigate, >>>>>> attempting to enter the folder containing the (57G) xml file fails with >>>>>> "MessageNotUnderstood: False>>humanReadableSIByteSize." Likewise if I get a >>>>>> FileReference with FileSystem disk root / 'path' / 'to' / 'file' then self >>>>>> exists returns false and the parser fails. >>>>>> >>>>>> Am I doing something wrong? Should I be able to do this? >>>>>> >>>>>> The version number is #40283 >>>>>> >>>>>> Thanks, >>>>>> Evan >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> www.tudorgirba.com >>>>> >>>>> "Every thing has its own flow" >>>>> >>>> >>>> >>> >>> Which OS ? >>> Can you check with other programs if this file is readable at all? >>> >>> >>> >>> >>> Nicolai >>> >>> >>> >> > > > > -- best, Eliot

Oct. 14, 2014

Re: [Pharo-users] Trouble opening large files

by Nicolai Hess

There is a bug report on mantis for squeaks unix vm. I think this applies to pharo too, although I don't know if this bug is still valid on recent squeak vm. http://bugs.squeak.org/view.php?id=7522 2014-10-14 17:43 GMT+02:00 Evan Donahue <emdonahu(a)gmail.com>: > The OS is Arch Linux. > > I can read the file with less. > > The problem, insofar as I can trace it, seems to stem from this line in > UnixStore: > > Primitives lookupDirectory: encodedPath filename: encodedBasename > > When I have my 57G file there this line returns nil. If I move the 57G > file and create a small file with the same name, the same command > successfully finds the file. I am not sure how large a file must be to > cause this issue, but A 1.5G file works fine. > > On Tue, Oct 14, 2014 at 8:17 AM, Nicolai Hess <nicolaihess(a)web.de> wrote: > >> 2014-10-14 6:38 GMT+02:00 Evan Donahue <emdonahu(a)gmail.com>: >> >>> Hi, thanks for the reply. >>> >>> The response is the same: "MessageNotUnderstood: >>> False>>humanReadableSIByteSize." >>> >>> This happens both to print-it as well as to do-it-and-go. Running the >>> command on the neighboring "wiki.torrent" torrent file yields the correct >>> 54kb. >>> >>> Thanks, >>> Evan >>> >>> On Tue, Oct 14, 2014 at 12:24 AM, Tudor Girba <tudor(a)tudorgirba.com> >>> wrote: >>> >>>> Hi, >>>> >>>> If I understand correctly, the failure occurs while navigating in the >>>> "Items" presentation. >>>> >>>> I cannot reproduce this problem because I do not have enough disk space >>>> for such a large file :). But, could you do the following and let me know >>>> what the outcome is: >>>> >>>> 'path/to/your/large/file.xml' asFileReference humanReadableSize >>>> >>>> ? >>>> >>>> Cheers, >>>> Doru >>>> >>>> >>>> >>>> On Tue, Oct 14, 2014 at 2:27 AM, Evan Donahue <emdonahu(a)gmail.com> >>>> wrote: >>>> >>>>> Hello, I've run into some odd behavior and wanted to check whether I >>>>> might be missing something: >>>>> >>>>> I have downloaded a copy of the english wikipedia as an xml file and >>>>> am hoping to (sax) parse it. However, I can't even seem to get pharo to >>>>> recognize that the file exists. >>>>> >>>>> If I open FileSystem disk root in the playground and naigate, >>>>> attempting to enter the folder containing the (57G) xml file fails with >>>>> "MessageNotUnderstood: False>>humanReadableSIByteSize." Likewise if I get a >>>>> FileReference with FileSystem disk root / 'path' / 'to' / 'file' then self >>>>> exists returns false and the parser fails. >>>>> >>>>> Am I doing something wrong? Should I be able to do this? >>>>> >>>>> The version number is #40283 >>>>> >>>>> Thanks, >>>>> Evan >>>>> >>>> >>>> >>>> >>>> -- >>>> www.tudorgirba.com >>>> >>>> "Every thing has its own flow" >>>> >>> >>> >> >> Which OS ? >> Can you check with other programs if this file is readable at all? >> >> >> >> >> Nicolai >> >> >> >

Oct. 14, 2014

Re: [Pharo-users] Trouble opening large files

by Evan Donahue

The OS is Arch Linux. I can read the file with less. The problem, insofar as I can trace it, seems to stem from this line in UnixStore: Primitives lookupDirectory: encodedPath filename: encodedBasename When I have my 57G file there this line returns nil. If I move the 57G file and create a small file with the same name, the same command successfully finds the file. I am not sure how large a file must be to cause this issue, but A 1.5G file works fine. On Tue, Oct 14, 2014 at 8:17 AM, Nicolai Hess <nicolaihess(a)web.de> wrote: > 2014-10-14 6:38 GMT+02:00 Evan Donahue <emdonahu(a)gmail.com>: > >> Hi, thanks for the reply. >> >> The response is the same: "MessageNotUnderstood: >> False>>humanReadableSIByteSize." >> >> This happens both to print-it as well as to do-it-and-go. Running the >> command on the neighboring "wiki.torrent" torrent file yields the correct >> 54kb. >> >> Thanks, >> Evan >> >> On Tue, Oct 14, 2014 at 12:24 AM, Tudor Girba <tudor(a)tudorgirba.com> >> wrote: >> >>> Hi, >>> >>> If I understand correctly, the failure occurs while navigating in the >>> "Items" presentation. >>> >>> I cannot reproduce this problem because I do not have enough disk space >>> for such a large file :). But, could you do the following and let me know >>> what the outcome is: >>> >>> 'path/to/your/large/file.xml' asFileReference humanReadableSize >>> >>> ? >>> >>> Cheers, >>> Doru >>> >>> >>> >>> On Tue, Oct 14, 2014 at 2:27 AM, Evan Donahue <emdonahu(a)gmail.com> >>> wrote: >>> >>>> Hello, I've run into some odd behavior and wanted to check whether I >>>> might be missing something: >>>> >>>> I have downloaded a copy of the english wikipedia as an xml file and am >>>> hoping to (sax) parse it. However, I can't even seem to get pharo to >>>> recognize that the file exists. >>>> >>>> If I open FileSystem disk root in the playground and naigate, >>>> attempting to enter the folder containing the (57G) xml file fails with >>>> "MessageNotUnderstood: False>>humanReadableSIByteSize." Likewise if I get a >>>> FileReference with FileSystem disk root / 'path' / 'to' / 'file' then self >>>> exists returns false and the parser fails. >>>> >>>> Am I doing something wrong? Should I be able to do this? >>>> >>>> The version number is #40283 >>>> >>>> Thanks, >>>> Evan >>>> >>> >>> >>> >>> -- >>> www.tudorgirba.com >>> >>> "Every thing has its own flow" >>> >> >> > > Which OS ? > Can you check with other programs if this file is readable at all? > > > > > Nicolai > > >

Oct. 14, 2014