zopectl on windows, or an alternative?

classic Classic list List threaded Threaded
7 messages Options
llcolombo llcolombo
Reply | Threaded
Open this post in threaded view
|

zopectl on windows, or an alternative?

Hi all,
I am running plone 3.4.4 (zeo conf) on a windows platform, multiple sites in
one data.fs.
I realized I am getting POSKeyError exceptions whenever I export as .zexp
one of the sites. Apparently the export is the only activity leading to
raise such exceptions, and also, the exported site gets succesfully imported
again, so nothing seems to be affected by such errors.
However, I would like to fix them (if possible).
I run fstest.py without detecting any error, but fsrefs.py instead prints
out:
oid 0x4ce79d BTrees._OOBTree.OOBucket 1 revision
    tid 0x038543340eff5144 offset=685773165 2010-04-05 11:00:03.515000
        tid user=' admin'
        tid description='/manage_importObject'
        new revision BTrees._OOBTree.OOBucket at 824603241
        referenced by 0x4ca6f1 BTrees._OOBTree.OOBTree at 923760249
        referenced by 0x4ce79c BTrees._OOBTree.OOBucket at 824605918
        references 0x4ce79e BTrees._OOBTree.OOBucket at 824603241
        references 0x4d4729 <unknown> at 824603241
        references 0x4d472a BTrees._OOBTree.OOSet at 824603241
        references 0x4d472b BTrees._OOBTree.OOSet at 824603241
        references 0x4d472c <unknown> at 824603241
        references 0x4d472d <unknown> at 824603241
        references 0x4d472e <unknown> at 824603241
        references 0x4d472f <unknown> at 824603241
        references 0x4d4730 <unknown> at 824603241
        references 0x4d4731 <unknown> at 824603241
        references 0x4d4732 <unknown> at 824603241
        references 0x4d4733 BTrees._OOBTree.OOSet at 824603241
        references 0x4d4734 BTrees._OOBTree.OOSet at 824603241
        references 0x4d4735 <unknown> at 824603241
        references 0x4d4736 <unknown> at 824603241
        references 0x4d4737 <unknown> at 824603241
        references 0x4d4738 <unknown> at 824603241
        references 0x4d4739 <unknown> at 824603241
        references 0x4d473a <unknown> at 824603241
I cannot figure out what these broken references actually are. I have read
that from a Zope debug console I could get the object for an oid, with ob =
app._p_jar[oid] .

But how do I run a Zope debug console on Windows? I have not found much
information in the internet, besides quite old emails saying that zopectl
was not working on windows. Is this still true? I see zopectl together with
the various runzope.bat, but is missing the .bat extension so am still
wondering if it is supposed to work or not,

Alternatively, how can I access my zope environment from a python prompt?

Thanks&bye

Lucia



------------------------------------------------------------------------------
Download Intel&#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Plone-Users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/plone-users
ajung ajung
Reply | Threaded
Open this post in threaded view
|

Re: zopectl on windows, or an alternative?

http://spamsch.blogspot.com/2009/04/how-to-repair-broken-zodb-poskeyerror.html

-aj

llcolombo wrote
Hi all,
I am running plone 3.4.4 (zeo conf) on a windows platform, multiple sites in
one data.fs.
I realized I am getting POSKeyError exceptions whenever I export as .zexp
one of the sites. Apparently the export is the only activity leading to
raise such exceptions, and also, the exported site gets succesfully imported
again, so nothing seems to be affected by such errors.
However, I would like to fix them (if possible).
I run fstest.py without detecting any error, but fsrefs.py instead prints
out:
oid 0x4ce79d BTrees._OOBTree.OOBucket 1 revision
    tid 0x038543340eff5144 offset=685773165 2010-04-05 11:00:03.515000
        tid user=' admin'
        tid description='/manage_importObject'
        new revision BTrees._OOBTree.OOBucket at 824603241
        referenced by 0x4ca6f1 BTrees._OOBTree.OOBTree at 923760249
        referenced by 0x4ce79c BTrees._OOBTree.OOBucket at 824605918
        references 0x4ce79e BTrees._OOBTree.OOBucket at 824603241
        references 0x4d4729 <unknown> at 824603241
        references 0x4d472a BTrees._OOBTree.OOSet at 824603241
        references 0x4d472b BTrees._OOBTree.OOSet at 824603241
        references 0x4d472c <unknown> at 824603241
        references 0x4d472d <unknown> at 824603241
        references 0x4d472e <unknown> at 824603241
        references 0x4d472f <unknown> at 824603241
        references 0x4d4730 <unknown> at 824603241
        references 0x4d4731 <unknown> at 824603241
        references 0x4d4732 <unknown> at 824603241
        references 0x4d4733 BTrees._OOBTree.OOSet at 824603241
        references 0x4d4734 BTrees._OOBTree.OOSet at 824603241
        references 0x4d4735 <unknown> at 824603241
        references 0x4d4736 <unknown> at 824603241
        references 0x4d4737 <unknown> at 824603241
        references 0x4d4738 <unknown> at 824603241
        references 0x4d4739 <unknown> at 824603241
        references 0x4d473a <unknown> at 824603241
I cannot figure out what these broken references actually are. I have read
that from a Zope debug console I could get the object for an oid, with ob =
app._p_jar[oid] .

But how do I run a Zope debug console on Windows? I have not found much
information in the internet, besides quite old emails saying that zopectl
was not working on windows. Is this still true? I see zopectl together with
the various runzope.bat, but is missing the .bat extension so am still
wondering if it is supposed to work or not,

Alternatively, how can I access my zope environment from a python prompt?

Thanks&bye

Lucia



------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Plone-Users mailing list
Plone-Users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/plone-users
llcolombo llcolombo
Reply | Threaded
Open this post in threaded view
|

Re: zopectl on windows, or an alternative?

thanks, but what shall I do at this point:
[...]
Put this script (named recover.py) into your PYTHONPATH and fire up zopectl
debug attached to the faulty database and then call import recover;
recover.check(app).

My question actually was, how do I fire up zopectl debug, on windows?

thanks&bye
Lucia

"ajung" <[hidden email]> ha scritto nel
messaggio news:[hidden email]...

>
> http://spamsch.blogspot.com/2009/04/how-to-repair-broken-zodb-poskeyerror.html
>
> -aj
>
>
> llcolombo wrote:
>>
>> Hi all,
>> I am running plone 3.4.4 (zeo conf) on a windows platform, multiple sites
>> in
>> one data.fs.
>> I realized I am getting POSKeyError exceptions whenever I export as .zexp
>> one of the sites. Apparently the export is the only activity leading to
>> raise such exceptions, and also, the exported site gets succesfully
>> imported
>> again, so nothing seems to be affected by such errors.
>> However, I would like to fix them (if possible).
>> I run fstest.py without detecting any error, but fsrefs.py instead prints
>> out:
>> oid 0x4ce79d BTrees._OOBTree.OOBucket 1 revision
>>     tid 0x038543340eff5144 offset=685773165 2010-04-05 11:00:03.515000
>>         tid user=' admin'
>>         tid description='/manage_importObject'
>>         new revision BTrees._OOBTree.OOBucket at 824603241
>>         referenced by 0x4ca6f1 BTrees._OOBTree.OOBTree at 923760249
>>         referenced by 0x4ce79c BTrees._OOBTree.OOBucket at 824605918
>>         references 0x4ce79e BTrees._OOBTree.OOBucket at 824603241
>>         references 0x4d4729 <unknown> at 824603241
>>         references 0x4d472a BTrees._OOBTree.OOSet at 824603241
>>         references 0x4d472b BTrees._OOBTree.OOSet at 824603241
>>         references 0x4d472c <unknown> at 824603241
>>         references 0x4d472d <unknown> at 824603241
>>         references 0x4d472e <unknown> at 824603241
>>         references 0x4d472f <unknown> at 824603241
>>         references 0x4d4730 <unknown> at 824603241
>>         references 0x4d4731 <unknown> at 824603241
>>         references 0x4d4732 <unknown> at 824603241
>>         references 0x4d4733 BTrees._OOBTree.OOSet at 824603241
>>         references 0x4d4734 BTrees._OOBTree.OOSet at 824603241
>>         references 0x4d4735 <unknown> at 824603241
>>         references 0x4d4736 <unknown> at 824603241
>>         references 0x4d4737 <unknown> at 824603241
>>         references 0x4d4738 <unknown> at 824603241
>>         references 0x4d4739 <unknown> at 824603241
>>         references 0x4d473a <unknown> at 824603241
>> I cannot figure out what these broken references actually are. I have
>> read
>> that from a Zope debug console I could get the object for an oid, with ob
>> =
>> app._p_jar[oid] .
>>
>> But how do I run a Zope debug console on Windows? I have not found much
>> information in the internet, besides quite old emails saying that zopectl
>> was not working on windows. Is this still true? I see zopectl together
>> with
>> the various runzope.bat, but is missing the .bat extension so am still
>> wondering if it is supposed to work or not,
>>
>> Alternatively, how can I access my zope environment from a python prompt?
>>
>> Thanks&bye
>>
>> Lucia
>>
>>
>>
>> ------------------------------------------------------------------------------
>> Download Intel&#174; Parallel Studio Eval
>> Try the new software tools for yourself. Speed compiling, find bugs
>> proactively, and fine-tune applications for parallel performance.
>> See why Intel Parallel Studio got high marks during beta.
>> http://p.sf.net/sfu/intel-sw-dev
>> _______________________________________________
>> Plone-Users mailing list
>> [hidden email]
>> https://lists.sourceforge.net/lists/listinfo/plone-users
>>
>>
> --
> View this message in context:
> http://n2.nabble.com/zopectl-on-windows-or-an-alternative-tp4883930p4884540.html
> Sent from the General Questions mailing list archive at Nabble.com.
>
> ------------------------------------------------------------------------------
> Download Intel&#174; Parallel Studio Eval
> Try the new software tools for yourself. Speed compiling, find bugs
> proactively, and fine-tune applications for parallel performance.
> See why Intel Parallel Studio got high marks during beta.
> http://p.sf.net/sfu/intel-sw-dev 



------------------------------------------------------------------------------
Download Intel&#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Plone-Users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/plone-users
llcolombo llcolombo
Reply | Threaded
Open this post in threaded view
|

Re: zopectl on windows, or an alternative?

In reply to this post by ajung
Hi,
I installed Clouseau and tried the suggested procedure.
Unfortunately, no error was found by fsrecover.py, but executing it did
somehow spoil the site: one folder had its position moved within its parent,
and across the whole site all attopics with a path criterion had the path
criterion blanked out. Re-setting the path criterion had the effect of
showing each folder in the criterion twice, removing the path criterion and
re-adding it seemed fine. But when I moved the folder back to its position
(I noticed that it moved only after having set some of the path criteria)
all the path criteria disappeared again.
So I  rebuilt all catalogs: uuid, references and portal catalog. Magically
all the path criteria came back and the site looked fine, but exporting it I
still got the original POSKeyException.
 After installing Clouseau, I run the recover.py script.
No error was found :-(

I am totally lost. The only tool that finds issues is fsrefs.py (as per
first email in thread). Within Clouseau, I did refer to the broken object -
is a BTrees._OOBTree.OOBucket - but I am totally unable to find out where it
is and how to fix the problem. It will not print and I have no idea about
how to get any information about an OOBucket.

Lucia


"ajung" <[hidden email]> ha scritto nel
messaggio news:[hidden email]...

>
> http://spamsch.blogspot.com/2009/04/how-to-repair-broken-zodb-poskeyerror.html
>
> -aj
>
>
> llcolombo wrote:
>>
>> Hi all,
>> I am running plone 3.4.4 (zeo conf) on a windows platform, multiple sites
>> in
>> one data.fs.
>> I realized I am getting POSKeyError exceptions whenever I export as .zexp
>> one of the sites. Apparently the export is the only activity leading to
>> raise such exceptions, and also, the exported site gets succesfully
>> imported
>> again, so nothing seems to be affected by such errors.
>> However, I would like to fix them (if possible).
>> I run fstest.py without detecting any error, but fsrefs.py instead prints
>> out:
>> oid 0x4ce79d BTrees._OOBTree.OOBucket 1 revision
>>     tid 0x038543340eff5144 offset=685773165 2010-04-05 11:00:03.515000
>>         tid user=' admin'
>>         tid description='/manage_importObject'
>>         new revision BTrees._OOBTree.OOBucket at 824603241
>>         referenced by 0x4ca6f1 BTrees._OOBTree.OOBTree at 923760249
>>         referenced by 0x4ce79c BTrees._OOBTree.OOBucket at 824605918
>>         references 0x4ce79e BTrees._OOBTree.OOBucket at 824603241
>>         references 0x4d4729 <unknown> at 824603241
>>         references 0x4d472a BTrees._OOBTree.OOSet at 824603241
>>         references 0x4d472b BTrees._OOBTree.OOSet at 824603241
>>         references 0x4d472c <unknown> at 824603241
>>         references 0x4d472d <unknown> at 824603241
>>         references 0x4d472e <unknown> at 824603241
>>         references 0x4d472f <unknown> at 824603241
>>         references 0x4d4730 <unknown> at 824603241
>>         references 0x4d4731 <unknown> at 824603241
>>         references 0x4d4732 <unknown> at 824603241
>>         references 0x4d4733 BTrees._OOBTree.OOSet at 824603241
>>         references 0x4d4734 BTrees._OOBTree.OOSet at 824603241
>>         references 0x4d4735 <unknown> at 824603241
>>         references 0x4d4736 <unknown> at 824603241
>>         references 0x4d4737 <unknown> at 824603241
>>         references 0x4d4738 <unknown> at 824603241
>>         references 0x4d4739 <unknown> at 824603241
>>         references 0x4d473a <unknown> at 824603241
>> I cannot figure out what these broken references actually are. I have
>> read
>> that from a Zope debug console I could get the object for an oid, with ob
>> =
>> app._p_jar[oid] .
>>
>> But how do I run a Zope debug console on Windows? I have not found much
>> information in the internet, besides quite old emails saying that zopectl
>> was not working on windows. Is this still true? I see zopectl together
>> with
>> the various runzope.bat, but is missing the .bat extension so am still
>> wondering if it is supposed to work or not,
>>
>> Alternatively, how can I access my zope environment from a python prompt?
>>
>> Thanks&bye
>>
>> Lucia
>>
>>
>>
>> ------------------------------------------------------------------------------
>> Download Intel&#174; Parallel Studio Eval
>> Try the new software tools for yourself. Speed compiling, find bugs
>> proactively, and fine-tune applications for parallel performance.
>> See why Intel Parallel Studio got high marks during beta.
>> http://p.sf.net/sfu/intel-sw-dev
>> _______________________________________________
>> Plone-Users mailing list
>> [hidden email]
>> https://lists.sourceforge.net/lists/listinfo/plone-users
>>
>>
> --
> View this message in context:
> http://n2.nabble.com/zopectl-on-windows-or-an-alternative-tp4883930p4884540.html
> Sent from the General Questions mailing list archive at Nabble.com.
>
> ------------------------------------------------------------------------------
> Download Intel&#174; Parallel Studio Eval
> Try the new software tools for yourself. Speed compiling, find bugs
> proactively, and fine-tune applications for parallel performance.
> See why Intel Parallel Studio got high marks during beta.
> http://p.sf.net/sfu/intel-sw-dev 



------------------------------------------------------------------------------
Download Intel&#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Plone-Users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/plone-users
ajung ajung
Reply | Threaded
Open this post in threaded view
|

Re: zopectl on windows, or an alternative?

As given link is very suitable for fixing PosKey errors. No idea about your zopectl problem.
Both scripts in blog entry should be runnable on Windows as well ...very likely without further changes! If not, ask Simon.

-aj
ajung ajung
Reply | Threaded
Open this post in threaded view
|

Re: zopectl on windows, or an alternative?

The script as given through the links are very suitable for fixing PosKey errors. No idea about your zopectl problem.
Both scripts in blog entry should be runnable on Windows as well ...very likely without further changes! If not, ask Simon.

-aj
ajung ajung
Reply | Threaded
Open this post in threaded view
|

Re: zopectl on windows, or an alternative?

In addition: regular backups and checks for PosKey errors is a must when you are running sites in production.

See http://www.zopyx.de/blog/checking-your-zodb-storages-for-poskey-errors

(everything else is unprofessional).

-aj