Codestrom - The Wandering Programmer

onnv-gate quick-start compile guide

Since google doesn't really want to be friendly and put howto compile onnv-gate at the top I thought this quick-start guide would maybe be helpful to others.

Two small disclaimers:

1. I'm working on a side project which changes all this for the better and could use help
2. I apologize if this entry is hard to read.  There's five steps and you'll have to read the notes since your env could differ from mine.

Prerequisites:

1. Patched SunStudio 12
2. Fixed patchadd
3. onbld tools
4. closed bins

Note: Currently, snv_103 onnv-gate requires SS12 (SunStudio 12)
http://developers.sun.com/sunstudio/

Here's how to fix patchadd if you haven't done so already

In this specific example I'm pulling revision 103..

# cd some/place/you/have/enough/space
(I build all my gates in /usr/local/src so will use that from now on.)

Step 1. Pull the onnv-gate source

# hg clone -r onnv_103 ssh://anon@hg.opensolaris.org/hg/onnv/onnv-gate

# We cd to onnv-gate only once because I assume you are doing this start-to-finish

# cd onnv-gate

Step 2. Copy and modify opensolaris.sh

# cp usr/src/tools/env/opensolaris.sh .

# vi opensolaris.sh # Or your favorite editor

 STAFF

    (Change to your current user)

GATE

    (Change from testws to onnv-gate)

CODEMGR_WS

    ( Change from /export/$GATE to /usr/local/src/$GATE or adjust as your path differs)

Step 3. Install onbld tools

Visit: http://dlc.sun.com/osol/on/downloads/b103/ # or bNNN for your revision of choice

Download: SUNWonbld.i386.tar.bz2

# bzip2 -dc /path/to/SUNWonbld-i386.tar.bz2 | tar xf -

# pkgadd -d onbld SUNWonbld # You'll have to be root to do this

# rm -rf /path/to/SUNWonbld

Note: You should add /opt/onbld/bin:/opt/onbld/bin/i386 to your path.. You'll need it later

Step 4. Unpack closed binaries

Note: Needed for now, but myself and others are working on removing this in OSUNIX

Download : on-closed-bins.i386.tar.bz2

# bzip2 -dc on-closed-bins.i386.tar.bz2 | tar xf -

Step 5. Building onnv-gate (fun part right?)

Choice 1. Whole thing and wait
    # nightly ./opensolaris.sh &

Choice 2. Pick an area
    # bldenv -d ./opensolarish.sh ; cd usr/src/somewhere ; dmake

Note: Must use posix make or dmake

Note:
kernel is in usr/src/uts which you have to build manually
Feel like hacking libc? usr/src/lib/libc

Congratulations! You've survived the Sun gauntlet for compiling onnv-gate for the first time.

Tips:

Adding this will save you time since the default opensolaris.sh will compile everything *twice* without it. (By twice I mean.. compiler with sun studio and 2nd secret shadow pass with gcc)

export CW_NO_SHADOW=

Thanks to Patrick for fixing the 64bit svc.configd bug

So if you're following some of my work you'll know I'm converting the whole onnv-gate over to 64bit.. (boring and nobody seems to care)  Anyway, ran into this bug in svc.configd.. Even if you had a serial cable it would lock the whole session and sending F1+a didn't matter.  So a very big thanks to Patrick Georgi for debugging the issue and coming up with this..

Before you go further note:

The author considers this a hack, and that the real fix would be to change TX_SIZE to be sizeof(int)-neutral

configd/object.c

326                                 //v = (uint32_t *)((caddr_t)str + TX_SIZE(*v));
327                                 v = &str[(v[0]+3)&~3];

646                 /* bp += sizeof (uint32_t) + TX_SIZE(value_len);*/
647                 bp += sizeof (uint32_t) + (value_len+3)&~3;

devzone is one handy little app

One of the Nexenta dev's has been working on polishing a side project that started out being for Nexenta, but he was kind enough to get it running on our platform..

So what's so cool about a devzone?  Well.. it's a mix between a global zone and a regular zone, but intended especially for those working in a quick-get-the-job done sense.  For example a regular user can grab a new zone using devzone_create, do what he/she needs to do, (package, fix a bug.. etc) and once finished release the zone with devzone_free. The only overhead is the difference between the master image.  It's already proved to be very beneficial to fixing and reproducing several bugs and so.. Wanted to say a big thanks.

Author: Tim Spriggs
Website: http://devzone.sourceforge.net/ (work in progress)

(I'll probably work on OpenSolaris with little/no changes, but this hasn't been confirmed)

Developers mailing list for OpenSolaris

Before I start rambling.. Here's the info on the new OpenSolaris technology development mailing list

http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/osunix-dev

or put subscribe in the subject and send a quick email to

osunix-dev-request@lists.scsys.co.uk

So with the fruits of my and others labor from hacking on OpenSolaris technology really starting to show I've made up a few goals:

    a) Help others do the same for areas they care about
    b) Create a means for new developers to get peer review/testing/feedback
    c) Lower the threshold for new developers
    d) Create resources people in the community can take advantage of

So with my humble bits of work I have 5-20 patches, depending if you count per file or per area, for onnv.  The other day for a two liner change I was advised to do a webrev (whatever that is) to get any review.  Basically, they can't think outside of the corporate box enough to imagine I wouldn't even know what that is.  Regardless of this I'm pretty sure the docs for this are pretty sparse outside of @Sun even if it's a one line command.  New developers need a lot of resources guiding them in the right direction.  I consider myself lucky to have stumbled upon those who are really knowledable and helpful, but really it should be a lot easier.  I know of no less than 3 other developers who are sitting on patches and not wanting to bother with the Sun contribution guantlet.  I'm tired of waiting and empty promises.  I think a BSD or Linus style approach to accepting contributions for a community effort is the way to go.  This isn't to say the Sun process is bad, but it's just slow to adapt and seems non-functional.  Worst case we accept a bunch of stuff under a BSD license and they have to OSR to get it included.

coreadm defaults for debugging

Mostly to serve as a reminder to myself and also note that the coreadm defaults aren't very good for debugging...

# Gain root privileges and do..

mkdir -p /var/core
coreadm -g /var/core/core.%f.%p.%t -e global -e process

# To make it permanent you'll need to modify
/etc/coreadm.conf

Debugging svc part 1 - onnv-gate env setup

Since I've hit a bug which is making me learn new OpenSolaris/Solaris tools I thought it'd make a perfect example and document the process of how to fix it from beginning to end..

This guide assumes little to no knowledge of building onnv-gate and thus there will be things which deviate from standard procedure in order to explain the code/parts a bit more and to reduce the things which happen behind the scenes when you simply run `nightly`

Note: I make an assumption you'll put the source at /usr/local/src, but adjust as needed

Lines starting with `#` Are comments and the rest are commands you execute in a terminal

# WARNING : The code we are building/debugging has 
# been modified to create a bug and only suitable 
# for learning purposes

# So lets get started on fixing our first bug in the OpenSolaris onnv-gate

mkdir -p /usr/local/src ; cd /usr/local/src

# You'll need the onnv-gate source if you don't have it already

hg clone ssh://anon@hg.opensolaris.org/hg/onnv/onnv-gate

# You'll notice that I don't pull the source 
# from a specific point, but the bug choosen 
# would normally be difficult to encounter and 
# until it's fixed upstream I'll leave it as-is 
# so you have the most current source.

# Here's the exact steps required in order to
# reproduce the svc build segfault for 


# Below is a tcsh env script that sets things
# up needed for this exercise.

# Note: You'd normally use bldenv ./opensolaris.sh and 
# do things slightly different, but configuring that 
# correctly will be done in another session

tcsh
unset correct
# Download opensolaris.sh in case you missed it before
source opensolaris.sh

# Authors note: Sorry to all the bash users, but it shouldn't be
# too hard to convert. I'll happily upload any alternatives


# Generate some general headers which 
# are needed across a lot of the build process
cd /usr/local/src/onnv-gate/usr/src/head ; make

# install_h is a common make target for
# headers which will be installed, generated and needed
cd /usr/local/src/onnv-gate/usr/src/lib/libsqlite ; make install_h

# libsqlite is a dep to svc our actual target
cd /usr/local/src/onnv-gate/usr/src/lib/libsqlite ; make

# Manually create some of the directories
# needed so we don't muck up the source or our development env
mkdir -p /usr/local/src/onnv-gate/proto/root_i386/lib/amd64
mkdir -p /usr/local/src/onnv-gate/proto/root_i386/usr/share/lib/xml/dtd
mkdir -p /usr/local/src/onnv-gate/proto/root_i386/usr/sadm/install
mkdir -p /usr/local/src/onnv-gate/proto/root_i386/usr/sadm/install/scripts
mkdir -p /usr/local/src/onnv-gate/proto/root_i386/lib/svc/bin
mkdir -p /usr/local/src/onnv-gate/proto/root_i386/var/svc/profile
mkdir -p /usr/local/src/onnv-gate/proto/root_i386/usr/sbin
mkdir -p /usr/local/src/onnv-gate/proto/root_i386/usr/bin
mkdir -p /usr/local/src/onnv-gate/proto/root_i386/usr/lib
mkdir -p
/usr/local/src/onnv-gate/proto/root_i386/var/svc/manifest/system/filesystem
mkdir -p /usr/local/src/onnv-gate/proto/root_i386/var/svc/manifest/milestone
mkdir -p /usr/local/src/onnv-gate/proto/root_i386/var/svc/manifest/network
mkdir -p /usr/local/src/onnv-gate/proto/root_i386/lib/svc/method/
mkdir -p
/usr/local/src/onnv-gate/proto/root_i386/var/svc/manifest/system/device
mkdir -p
/usr/local/src/onnv-gate/proto/root_i386/var/svc/manifest/system/svc
mkdir -p /usr/local/src/onnv-gate/proto/root_i386/lib/svc/share

# Couple small hacks for this exercise and normally 
# stuff like this isn't needed
cp /usr/local/src/onnv-gate/usr/src/lib/libsqlite/i386/libsqlite.o
/usr/local/src/onnv-gate/proto/root_i386/usr/lib/
# cd /usr/local/src/onnv-gate/usr/src/common/mapfiles/gen ; make
amd64_cc_map.noexeglobs
cd /usr/local/src/onnv-gate/usr/src/common/mapfiles/gen ; make
i386_cc_map.noexeglobs

# Now we dive into the cmd/ directories which
# has tons of commands used throughout Solaris/OpenSolaris
# svc == smf if you're not already familiar with it
# http://opensolaris.org/os/community/smf/

cd /usr/local/src/onnv-gate/usr/src/cmd/svc

# You'll need to do these manually if the white space gets messed up
sed -i -e '/native:/c\native: \
native_old:' configd/Makefile

sed -i -e '/native:/c\native: \
native_old:' svccfg/Makefile

sed -i -e 's/-native//' seed/Makefile
sed -i -e 's/native//' seed/Makefile

# and finally we run make on our target
cd /usr/local/src/onnv-gate/usr/src/cmd/svc ; make

# Make will fail and as it does you'll
# need to patch the code with the below patches
-----
# Patches are relative to /usr/local/src/onnv-gate/usr/src/cmd/svc
-----
--- configd/rc_node.c.old 2008-12-01 08:36:51.665559590 -0800
+++ configd/rc_node.c 2008-12-01 08:37:02.070424794 -0800
@@ -6249,7 +6249,7 @@
 */
 int
 rc_node_setup_iter(rc_node_ptr_t *npp, rc_node_iter_t **iterp,
- uint32_t type, uint32_t flags, const char *pattern)
+ uint32_t type, size_t flags, const char *pattern)
 {
  rc_node_t *np;
  rc_iter_filter_func *f = NULL;
--------
--- startd/libscf.c.old 2008-12-01 08:53:06.705377781 -0800
+++ startd/libscf.c 2008-12-01 08:53:59.890145090 -0800
@@ -3182,7 +3182,7 @@
 */
 int
 libscf_unset_action(scf_handle_t *h, scf_propertygroup_t *pg,
- admin_action_t a, hrtime_t ts)
+ admin_action_t a, int64_t ts)
 {
  scf_transaction_t *t;
  scf_transaction_entry_t *e;
----------