Codestrom - The Wandering Programmer

sun cc 1 man - all compiler options why to care

Firstly, if you're packaging quite a bit of software.. having this page handy when you're first learning can be invaluable..

http://docs.sun.com/app/docs/doc/819-5265/bjapp?a=view

Here's a real world example of why enable -fast can bite you..  As the sun guys and manual says -fast is a micro option which enables other options.. By adding -# you can see what's explicitly being set.. (look below)

So I had a bugger of a textrel I couldn't find the root cause of.. the symbol ld was referring to was garbage.. It didn't occur to me it could be a compiler bug at first, but all things do come with bugs..

So in the end.. removing -xbuiltin=%all caused the textrel to go away, but the fault or a better work-around hasn't been determined.  The sun compiler guys are great and I'm sure they'll let me know what's at the root of this.

----

### Note: NLSPATH = /opt/SUNWspro/prod/bin/../lib/locale/%L/LC_MESSAGES/%N.cat:/opt/SUNWspro/prod/bin/../../lib/locale/%L/LC_MESSAGES/%N.cat
###     command line files and options (expanded):
### -c -DHAVE_CONFIG_H -DRL_LIBRARY_VERSION=5.2 -D__MATHERR_ERRNO_DONTCARE -D_GNU_SOURCE -fns -nofstore -fsimple=2 -fsingle -I. -I.. -I.. -KPIC -xalias_level=basic -xarch=ssse3 -m64 -xbuiltin=%all -xchip=core2 -xlibmil -xO5 -xregs=no%frameptr -xspace -xstrconst -i -lc ../bind.c -o bind.o
/opt/SUNWspro/prod/bin/acomp -xldscope=global -i ../bind.c -xir_types -arrayloc -o /tmp/acompAAA.26891.VEayH0 -r /tmp/acompBAA.26891.WEayH0 -xdbggen=no%stabs+dwarf2+usedonly -DHAVE_CONFIG_H -DRL_LIBRARY_VERSION=5.2 -D__MATHERR_ERRNO_DONTCARE -D_GNU_SOURCE -single -I. -I.. -I.. -strconst -fns -xalias_level=basic -2K -m64 -fparam_ir -O5 -Qy -D__SunOS_5_11 -D__SUNPRO_C=0x5100 -D__SVR4 -D__sun -D__SunOS -D__unix -D__x86_64 -D__x86_64__ -D__amd64 -D__amd64__ -D__BUILTIN_VA_STRUCT -D__C99FEATURES__ -Xa -D__PRAGMA_REDEFINE_EXTNAME -Dunix -Dsun -D__RESTRICT -xbuiltin=%all -xc99=%all,no%lib -D__FLT_EVAL_METHOD__=0 -I/opt/SUNWspro/prod/include/cc "-g/opt/SUNWspro/prod/bin/cc -c -DHAVE_CONFIG_H -DRL_LIBRARY_VERSION='5.2' -D__MATHERR_ERRNO_DONTCARE -D_GNU_SOURCE -fns -nofstore -fsimple=2 -fsingle -I. -I.. -I.. -KPIC -xalias_level=basic -xarch=ssse3 -m64 -xbuiltin=%all -xchip=core2 -xlibmil -xO5 -xregs=no%frameptr -xspace -xstrconst -i -lc -o bind.o " -fsimple=2 -D__SUN_PREFETCH -destination_ir=iropt
/opt/SUNWspro/prod/bin/iropt -F -o /tmp/iroptDAA.26891.YEayH0 -N/tmp/iroptCAA.26891.XEayH0 -is /tmp/acompAAA.26891.VEayH0 /tmp/acompBAA.26891.WEayH0 -xarch=ssse3 -m64 -xcache=generic -xchip=core2 -fns -fsimple=2 -xprefetch=auto,explicit -xprefetch_level=1 -xvector=no -xbuiltin=%all -xspace -xalias_level=basic -k -O5 -Qy
/opt/SUNWspro/prod/bin/ir2hf -verbose -m64 /tmp/iroptDAA.26891.YEayH0 /tmp/acompAAA.26891.VEayH0 /tmp/iroptEAA.26891.ZEayH0 /opt/SUNWspro/prod/bin/fbe -O5 -xbuiltin -Qy
/opt/SUNWspro/prod/bin/ube -iropt -verbose -O5 -Z~B -xalias_level=basic -xbuiltin -fsimple=2 -fsr=1 -xprefetch=auto,explicit -xprefetch_level=1 -fbe /opt/SUNWspro/prod/bin/fbe -il /opt/SUNWspro/prod/lib/amd64/libm.il -PIC -m64 -xarch=ssse3 -xcache=generic -xchip=core2 -xspace -xvector=no -xthreadvar=dynamic -Qy -comdat -ipo bind.o -S /tmp/ube_sGAA.26891.0EayH0 /tmp/iroptEAA.26891.ZEayH0
/opt/SUNWspro/prod/bin/fbe -xarch=amd64 -xchip=core2 -o bind.o -Qy /tmp/ube_sGAA.26891.0EayH0
Text relocation remains                     referenced
   against symbol            offset    in file
.CG68.2305                          0x8ac         bind.so
ld: fatal: relocations remain against allocatable but non-writable sections

Thanks for the feedback

So to start thanks for the honest feedback.  On the surface I could easily have a bruised ego, but in reality it's quite hard to find those who will be honest with you.  For me I try to deal with problems that I can solve in the most direct way possible.  To state the obvious.. so far I haven't blogged about anything other than desktop issues revolving around OpenSolaris.  There's no distributed dc research, cluster node images and not even a trace of the performance profiling I've done in various projects.  I could make excuses, but frankly at the time I was more busy working than trying to write about it.  So when I decided to switch platforms over to OpenSolaris from linux I wanted to document how someone goes from the bottom up.  Had I known it would shoot me in the foot to make a howto on Skype running in a linux26 brandz I'd surely not have done it.  On the other hand, thousands of people each month who are all new to OpenSolaris see this blog and may find it helpful.  So as my side project matures and the target audience changes the posts will go into greater depths such as how to debug using kmdb/mdb/dbx, dtracing to find some obscure memory leak, porting software, performance profiling and or how to use libzfs to build an interface on a storage platform.  All things that with time will come.

All honest feedback welcome

HOWTO get the lastest Perl maintenance sources

Mostly so I don't somehow forget when I need it quickly, but

rsync -avz rsync://public.activestate.com/perl-5.10.x/ perl-5.10.1

Why do/did I need this.. simple. the version of perl included in OpenSolaris is ancient, should be updated and I question how well it's maintained.   

Howto - compile perl for AMD64 on solaris

So today I had the "fun" of getting to compile perl for Solaris / OpenSolaris.. At first it was quite frustrating to be honest, but with the help from a few people and especially a couple guys in #perl I was on my way..

First a bit of warning..

1) It's completely untested
2) There's some failed tests (32bit version only had 1 failure vs 16)
3) It's *slower* than 32bit version compiled with SSX
4) I've changed things because I felt it was slightly more accurate
5) It may even play nice with a 32bit version installed, but I haven't tested this. (I'm working entirely in a minimal chroot env)

So.. where to start..  This guide is for a couple types of people..
1) You're using gentoo-alt and don't want to use the crackhead work they've managed to mangle together
2) You're *really* in need of a 64bit version for whatever reason
3) You'd like to fix one of the test failures (feel free to point out if it's my fault)
4) Something else which I'm forgotting because I'm more thinking about what I'll eat for dinner

--------------------
HOWTO

1) Really big maintenanace patch for 5.10.0-2008-10-20
2)  Extraneous configure options (feel free to comment/correct/laugh as needed.. easter egg included :)

./Configure -des -A 'ccflags=-D_REENTRANT  -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DPERL_USE_SAFE_PUTENV -i -m64  -xspace -xstrconst -fast -xregs=no%frameptr ' -Dprefix=/usr -Dusethreads -Duse64bitall -A 'ldflags= -m64 -L/opt/SUNWspro/prod/lib/amd64 -L/lib/amd64 -L/usr/lib/amd64 ' -D 'ccflags_uselargefiles=-i -m64 -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64' -A 'lddlflags= -G -m64 -L/opt/SUNWspro/prod/lib/amd64 -L/lib/amd64' -Dlibc=/lib/amd64/libc.so -D'libpth=/opt/SUNWspro/prod/lib/amd64 /lib/amd64  /usr/lib/amd64 /usr/ccs/lib/amd64' -D 'installbin=/usr/bin/amd64' -D 'installscript=/usr/bin/amd64' -D 'installsitebin=/usr/bin/amd64' -D 'installsitescript=/usr/bin/amd64' -D 'archlib=/usr/lib/amd64/perl5/5.10.0/i86pc-solaris-thread-multi-64' -D 'archlibexp=/usr/lib/amd64/perl5/5.10.0/i86pc-solaris-thread-multi-64' -A 'glibpth= /lib/amd64 /usr/lib/amd64 ' -D 'installarchlib=/usr/lib/amd64/perl5/5.10.0/i86pc-solaris-thread-multi-64' -D 'installprivlib=/usr/lib/amd64/perl5/5.10.0' -D 'installsitearch=/usr/lib/amd64/perl5/site_perl/5.10.0/i86pc-solaris-thread-multi-64' -D 'installsitelib=/usr/lib/amd64/perl5/site_perl/5.10.0' -D 'installstyle=lib/amd64/perl5' -D 'libsdirs= /lib/amd64' -D 'libs=-lsocket -lnsl -ldl -lm -lpthread -lc' -D 'cccdlflags=-KPIC ' -D 'ccversion=Sun C 5.9 SunOS_i386 Patch 124868-07 2009/10/07' -D 'cf_by=nobody' -D 'cf_email=nobody@perl.org'  -D cppflags='-D_REENTRANT -xarch=generic64 -D_REENTRANT  -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DPERL_USE_SAFE_PUTENV -i -m64' -D 'cppsymbols=__amd64=1 __amd64__=1 _FILE_OFFSET_BITS=64 _LARGEFILE64_SOURCE=1 _LARGEFILE_SOURCE=1 _LITTLE_ENDIAN= _LP64= _REENTRANT=1 __STDC__=0 sun=1 __sun=1 __SVR4=1 unix=1 __unix=1 __x86_64=1 __x86_64__=1' -D 'archname=amd64-solaris-thread-multi-64' -D 'c='\c' -D 'd_readdir64_r=define' -D 'd_suidsafe=define' -D 'myarchname=i86pc-solaris' -D 'n=-n' -D 'optimize=undef'  -D 'perladmin=undef' -D 'privlib=/usr/lib/amd64/5.10.0' -D 'privlibexp=/usr/lib/amd64/perl5/5.10.0' -D 'readdir64_r_proto=REENTRANT_PROTO_I_TSR' -D 'sitearch=/usr/lib/amd64/perl5/site_perl/5.10.0/amd64-solaris-thread-multi-64' -D 'sitearchexp='/usr/lib/amd64/perl5/site_perl/5.10.0/amd64-solaris-thread-multi-64'  -D 'sitelib=/usr/lib/amd64/perl5/site_perl/5.10.0' -D 'sitelib_stem=/usr/lib/amd64/perl5/site_perl' -D 'sitelibexp=/usr/lib/amd64perl5/site_perl/5.10.0' -D 'usemallocwrap=define'

3) make
4) make test

amd64 SS12 u=2.22  s=1.49  cu=235.05  cs=25.93  scripts=1501  tests=207635
x86      SSX   u=2.04 s=1.35 cu=215.97 cs=23.16 scripts=1450 tests=201166
amd64 SSX   u=2.31 s=1.57 cu=197.75 cs=24.98 scripts=1386 tests=187925

If anyone is interested I'll do something a bit more precise.. I'm not that familiar with perl so take it with a grain of salt.

5) failed tests..
Failed 16 tests out of 1501, 98.93% okay.
    ../ext/POSIX/t/posix.t
    ../lib/Archive/Extract/t/01_Archive-Extract.t
    ../lib/CPANPLUS/Dist/Build/t/02_CPANPLUS-Dist-Build.t
    ../lib/CPANPLUS/t/20_CPANPLUS-Dist-MM.t
    ../lib/ExtUtils/CBuilder/t/02-link.t
    ../lib/ExtUtils/t/Constant.t
    ../lib/ExtUtils/t/INSTALL_BASE.t
    ../lib/ExtUtils/t/PL_FILES.t
    ../lib/ExtUtils/t/hints.t
    ../lib/ExtUtils/t/xs.t
    ../lib/FileHandle.t
    ../lib/Module/Build/t/basic.t
    ../lib/Module/Build/t/compat.t
    ../lib/Module/Build/t/install.t
    ../lib/Module/Build/t/tilde.t
    op/magic.t
----
I'll optimize and package in the coming weeks.. so ping me if you're interested   

OpenSolaris mp3 support

Three easy steps to get MP3 support on OpenSolaris

I'm explain less of the why at first and be more clear on easy and how..

Step 1)
It's free and they don't spam so just here https://shop.fluendo.com

Direct link to fluendo mp3 codec for solaris

(Note.. fluendo changed their site a bit and you select the OS after everything)

You will have to select Solaris instead of Linux

Step 2)

# bunzip2 < Desktop/fluendo-mp3-4.solaris-intel.tar.bz2  | tar -xvf -

Step 3)

# mkdir -p ~/.gstreamer-0.10/plugins; cp ./codecs/* ~/.gstreamer-0.10/plugins/

I'm currently working on a way to help make this even easier, but the caveat is I'm selfish and it'll be for x86_64 only..

Ping me if you're interested..

PS.. Sun is also rumored to be working on a solution, but until then don't hope your breath for MP3 support out of the box on OpenSolaris

howto rescue boot opensolaris

Ok.. so tonight I had a taste of panic not because after a month of uptime some things were beginning to act strange or earlier today I crashed opensolaris xorg watching a movie.. (mplayer compiled with suncc thank you)..

so before I forget a few notes to those who may have similar trouble..

***BIG WARNING***
if you use reboot instead of init 6 you may end up for a surprise

This post is AS-IS and may break things worse or eat your lunch.. Use at your own risk..
You'll need a way to boot into console mode from a livecd (genunix.org) or some other means.. username/password for the livecd is jack / jack..

to gain root priveleges type pfexec su -

Always use init 6 unless you know better

I had a corrupted boot archive..
With an error like
krtld could neither locate nor resolve symnbols for /platform/i86pc/kernel/amd86/unix in the boot archive.. etc etc..

HOWTO Fix a non booting OpenSolaris
Use this as a last resort

Step 1) type zpool import

You'll get a list of possible import(s) (probably rpool.. If it's not rpool you'll have to adjust accordingly for the steps below

Note: you may not receive the error..

filesystem 'rpool/ROOT/opensolaris' cannot be mounted using 'mount -F zfs'
Use 'zfs set mountpoint=/rootfs' instead.
If you must use 'mount -F zfs' or /etc/vfstab, use 'zfs set mountpoint=legacy'.
See zfs(1M) for more information.

To fix this do

Step 1.b) zfs set mountpoint=legacy rpool/ROOT/opensolaris

Step 2) zpool import -R /mnt -f rpool

(Notice the rpool name. you may have to change that and the -f is force.. use with caution)

Step 3) mkdir /rootfs ; mount -F zfs rpool/ROOT/opensolaris /rootfs

(If you've been messing around with pkg image-update or beadm this howto may have you lose updates.. be careful)

Step 4) Optional

rm /rootfs/platform/i86pc/boot_archive
rm /rootfs/platform/i86pc/amd64/boot_archive

(This will remove your boot archive.. (kernel and other things. I had to do it, but you may not. ymmv.. )) If it fails without doing this then maybe give it a try..

Step 5) bootadm update-archive -R /rootfs

Step 6) umount /rootfs

Step 7) init 6

Good luck and feel free to report any success or failures.. comments are moderated, but I'll read or approve them

Lastly, but certainly not forgotten..

A *BIG* thanks to moinakg from the belenix team who was able to walk me through this tonight..

Zen of Python

I've been learning Python so I can start coding on the ospkg project I've been rambling and proposing for some time, but really the more I dig in the more I really have started enjoying the language.

Here's an eloquent example

From a prompt do
> python
> import this

The Zen of Python, by Tim Peters

Beautiful is better than ugly.
Explicit is better than implicit.
Simple is better than complex.
Complex is better than complicated.
Flat is better than nested.
Sparse is better than dense.
Readability counts.
Special cases aren't special enough to break the rules.
Although practicality beats purity.
Errors should never pass silently.
Unless explicitly silenced.
In the face of ambiguity, refuse the temptation to guess.
There should be one-- and preferably only one --obvious way to do it.
Although that way may not be obvious at first unless you're Dutch.
Now is better than never.
Although never is often better than *right* now.
If the implementation is hard to explain, it's a bad idea.
If the implementation is easy to explain, it may be a good idea.
Namespaces are one honking great idea -- let's do more of those!

green party plan

After watching just briefly the vp presidential debate and also ralph naders running mate.. The biggest contrast I see is not necessarily in that of policy and would they would be able to put in action, but that of leadership and a perceived ability to hold strong and fast when for 4 years you'll have the highest pressure job.. Not only for personal decisions, but also tactful and political.  Holding a hard line and enforcing or pushing environmental issues is *very* important and at the same time these people who want to make change must accept one thing first and foremost..  Politics isn't built upon innovation in the US, but by managerial like decisions where popularity and peeking order is still king.  Until someone who is about change can prove and show a track record of success there isn't going to be a snowballs chance of them winning the presidential election.. (No mater how great their funding or policy isn.)

The green parties 20 year plan is what we should be looking at.  Today we have a solid foundation which we should take advantage of.. slowly build stronger and also create realistic expectations for the results we as the green party will and can achieve.  Focusing on local and state issues more than federal is the best start.  Create a campaign based on success and not just about policy change.

The presidential and political influences start from the ground up.. The people. the businesses.. the morally conscious.. This is the start..

1) Win your friends and family
2) Win a race to be mayor and turn your city into a shining green example
3) Win a congressional/senate seat and win between doing the right thing and also understand you are on enemy foreign territory playing by their rules
4) Win a governor  election

Independent nobodies regardless of how intelligent there are realistic face a much greater challenge than something trying to make a lateral job change.  That's really what this is about.. the people voting to hire the next commander in chief.. Do you put the rookie with great ideas in charge or the manager who has been leading a branch of the company of one degree of success or another for the past 20 years. Open your eyes and face not only environmental issues, but political change ones as well.  Radical change would only bring fear and uncertainty to unproven and sometimes only theoretical data.

Turn the ship one degree at a time...

prodreg uinstall Sun Studio 12 software -i 1

Ok.. so today I'm the hasty programmer instead of the wandering programmer...

I thought.. and forgive me IPS packaging gods that I could just rm -rf SUNWspro install directory... reinstall the damn thing and be on my merry way, but I should reassure you this isn't the case..

save some time.. just
#rm /var/sadm/install/productregistry

and run the installer again.. because trying to uninstall sun studio 12 is not happening on indiana..

oh.. and what's the bad news.. well..

# prodreg browse
Segmentation fault (core dumped)

welcome to the land of undocumented features..

Yeah. prodreg doesn't have a gui on indiana so you're sol..

As I'm sure they would say "patches welcome"

<rant />

howto fix patchadd on indiana opensolaris

WARNING: This is a rambling and ranting post..

First of all.. this shouldn't really be part of something you need to normally do.. However, because of compiler bugs I hit when adding the -fast optimization for my sun cc port of mplayer I had to install sun studio 12.. Anyway.. so without the -fast and with things disabled you should be ok. However, not placated to merely have ported it I would like to be able to optimize it and enable a few more codecs.. (for what it's worth even without -fast it seemed to run fine/maybe better than without it)

So my original itch came when I was working on my ospkg project and realized.. that there wasn't a port of sun cc for mplayer.. I found a post by
sartek

Who I guess had asked dclarke and either dclarke didn't have the patch or simple didn't have the (time?) to release them..

Anyway..

So before you download Sun Studio 12 and install apply the patch below if you're on indiana.

This bug report
http://defect.opensolaris.org/bz/attachment.cgi?id=345&action=edit

# cd /usr/lib/patch/
and more specifically this patch
# wget "http://defect.opensolaris.org/bz/attachment.cgi?id=345"
# mv attachment.cgi\?id=345 patchadd.diff
# patch -p0 < patchadd.diff

Note: With some fuzz and I assume you already have a sane patch in your path
[type patch
patch is a tracked alias for /opt/ospkg/usr/bin/patch]