Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 42498 - Developing an "app-forensics" tree branch for portage
Summary: Developing an "app-forensics" tree branch for portage
Status: RESOLVED FIXED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: [OLD] Unspecified (show other bugs)
Hardware: All Linux
: High enhancement (vote)
Assignee: Forensics Herd [disbanded]
URL: http://www.opensourceforensics.org/to...
Whiteboard:
Keywords: EBUILD
Depends on:
Blocks:
 
Reported: 2004-02-22 09:49 UTC by Mitchell
Modified: 2009-03-08 00:27 UTC (History)
4 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
Foremost 0.69 ebuild (foremost-0.69.ebuild,896 bytes, text/plain)
2004-03-06 21:52 UTC, Mitchell
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Mitchell 2004-02-22 09:49:11 UTC
Currently, Gentoo lacks the ability to "emerge" tools that would be used in performing a forensic investigation.  These tools include, but are not limited to:

1. The Coroner's Toolkit (http://www.porcupine.org/forensics/tct.html)
2. Sleuthkit (http://www.sleuthkit.org)
3. Autopsy (http://www.sleuthkit.org)
4. Foremost (http://foremost.sf.net)

Reproducible: Always
Steps to Reproduce:
Comment 1 Joshua Brindle (RETIRED) gentoo-dev 2004-02-22 15:18:34 UTC
neat.. got any ebuilds for these?

Also, these sorts of things would be much more useful on a livecd, what do you think zhen?
Comment 2 solar (RETIRED) gentoo-dev 2004-02-22 18:20:17 UTC
These two could be moved into "app-forensics" after Mitchell attaches the ebuilds, then yn.

app-admin/aide
dev-util/examiner 
Comment 3 solar (RETIRED) gentoo-dev 2004-02-22 18:21:38 UTC
then only a few more would be needed to justify "app-forensics"
Comment 4 SpanKY gentoo-dev 2004-02-22 18:59:14 UTC
well, could we consider the category as a place for pre and post investigation ? thus aide and tripwire and similar IDS's could go in it
Comment 5 David M. Andersen 2004-02-22 19:17:44 UTC
Stegdetect (http://www.outgress.org/) - tries to detect steganography

Fatback (http://www.sf.net/projects/biatchux/) - attempts to unerase FAT stuff



http://sourceforge.net/project/showfiles.php?group_id=78332
http://odessa.sourceforge.net/
Open data duplicator
Galleta - IE Cookie Parser
Pasco - IE Activity Parser
Rifiuti - Recycle Bin Analyzer


Fun stuff to read:
http://www.blackhat.com/presentations/bh-usa-03/bh-us-03-willis-c/bh-us-03-willis.pdf
http://www.crazytrain.com/monkeyboy/csi_2003_linux_forensics.pdf
http://sourceforge.net/softwaremap/trove_list.php?form_cat=43

I'll see if I can find anything else.
Comment 6 Joshua Brindle (RETIRED) gentoo-dev 2004-02-22 19:26:23 UTC
i don't know about steganography.. it's a sensitive subject in america
see http://niels.xtdnet.nl/stego/
Comment 7 SpanKY gentoo-dev 2004-02-22 19:38:20 UTC
i really dont think we should let that kind of crap affect the addition of steganography related programs ...

after all, if it's truely questionable, we just change the ebuild to have RESTRICT=nomirror and Gentoo should be in the clear ... we host scripts that fetch files and build them, that's it
Comment 8 David M. Andersen 2004-02-22 20:03:53 UTC
Oops... wrong URL... http://www.outguess.org/detection.php

Also:

http://sourceforge.net/projects/ol2mbox/
Outlook to mbox converter (used for litigation support, etc., but also useful for anyone.)  Note that this guy MIGHT have been threatened by microsoft as some of the content from his page has mysteriously disappeared that contained newer versions and they once mentioned legal issues.  The program works fairly well, though.

http://sourceforge.net/projects/air-imager/
AIR (Automated Image & Restore) is a GUI front-end to dd/dcfldd designed for easily creating forensic bit images. Supports verification via MD5/SHA1, SCSI tape drives, imaging over a TCP/IP network, and complete session logging. 

http://sourceforge.net/projects/regviewer/
RegViewer is GTK 2.2 based GUI Windows registry file navigator. It is platform independent allowing for examination of Windows registry files from any platform. Particularly useful when conducting forensics of Windows files from *nix systems. 

http://freshmeat.net/projects/ftimes/
FTimes is a system baselining and evidence collection tool. Its primary purpose is to gather and/or develop information about specified directories and files in a manner conducive to intrusion analysis. It was designed to support the following initiatives: content integrity monitoring, incident response, intrusion analysis, and computer forensics. 

http://freshmeat.net/projects/rda/
RDA is a computer forensics tool to remotely acquire data. Usually disk cloning or disk/partition imaging means one has to move the disk onto another system, and things are more complicated if its a laptop disk. The alternative provided by rda is to boot the data source machine with a minimal Linux system from a floppy or CD, and simply run rda. Some of the options provided are data transfer verification with MD5 and/or CRC32 checksums, skipping read errors, and spanning over multiple files. 

http://software.freshmeat.net/projects/fohad/
The Forensic Hash Database is a project to combine the various hashsum sources like The KnownGoods Database, Hashkeeper, NIST NSRL, and Dan Farmer's hashsum archive into a single meta database. Integration into the forensic analysis toolkit The Sleuth Kit is provided through a patch.



Comment 9 Joshua Brindle (RETIRED) gentoo-dev 2004-02-23 12:59:29 UTC
wow, i don't have time to write ebuilds for all these, any volunteers?
Comment 10 David M. Andersen 2004-03-05 13:41:19 UTC
I guess I'll do a few.
Comment 11 Mitchell 2004-03-06 20:20:23 UTC
Can someone merge http://bugs.gentoo.org/show_bug.cgi?id=39934 and http://bugs.gentoo.org/show_bug.cgi?id=39935 into the portage tree as ~x86?
Comment 12 Mitchell 2004-03-06 21:52:19 UTC
Created attachment 26972 [details]
Foremost 0.69 ebuild

Foremost ebuild that I am not sure if it works or not.
Comment 13 solar (RETIRED) gentoo-dev 2004-03-06 22:04:55 UTC
re comment #10
I don't think either of the two will be accepted as is. Both of those ebuilds look like they need to use the portage api, install docs to the right place etc..
Comment 14 Diego Garcia 2004-03-07 08:45:40 UTC
i can write few ebuilds more about this subject this week.
Comment 15 Jeff Caplan 2004-03-28 13:12:13 UTC
I just really wanted to list my support for this particular tree for gentoo..I can't wait until the ebuilds are implemented for these packages.

~jeff~
Comment 16 solar (RETIRED) gentoo-dev 2004-04-25 19:20:30 UTC
Diego, 
Hows it coming?
Comment 17 Mitchell 2004-04-27 11:45:21 UTC
Looks like foremost was already to the portage tree under bug #47094
Comment 18 Mitchell 2004-05-06 06:59:45 UTC
Two new ebuilds have been written and added to the portage tree in order to respond to the needs of another user.   The first is bug #47096, which covers sleuthkit and now replaces Diego's ebuild in bug #39935.  The second is bug #47097, which covers autopsy.
Comment 19 Daniel Black (RETIRED) gentoo-dev 2004-08-15 08:27:03 UTC
=  The Coroner's Toolkit - bug #39934
The rest in comment #8 and comment #5 are not implemented.
David or Diego any more thoughts on the ebuilds.

Package commited (or almost)
stegdetect - getting around a few compile problems - hasn't been touched for ages though
sys-apps/memdump - Almost there
app-admin/autopsy - done
app-admin/sleuthkit = done
app-admin/aide - done
dev-util/examiner -done
app-admin/foremost -done
sys-apps/air = http://air-imager.sourceforge.net/ = done
Comment 20 Joshua Brindle (RETIRED) gentoo-dev 2004-09-08 18:22:18 UTC
bug-wranglers

hardened doesn't have the resources to support this, can you try to find someone else to do so?
Comment 21 Andreas Kobara 2004-09-09 01:29:50 UTC
Don't forget

app-admin/chkrootkit
app-admin/rkhunter
Comment 22 Daniel Black (RETIRED) gentoo-dev 2004-09-09 21:46:40 UTC
http://sourceforge.net/projects/pyflag is another one for consideration.

FLAG was designed to simplify the process of log file analysis and forensic investigations. FLAG facilitates efficient analysis of large quantities of data within an interactive environment. PyFlag is the reimplementation of FLAG in Python
Comment 23 Daniel Black (RETIRED) gentoo-dev 2004-09-11 04:47:50 UTC
Email sent to gentoo-dev seeking approval for category.

This doesn't realy bock bug 39934.
Comment 24 Daniel Black (RETIRED) gentoo-dev 2004-09-11 23:10:32 UTC
soon to be fixed....
Comment 25 Daniel Black (RETIRED) gentoo-dev 2004-09-17 17:11:48 UTC
Well the branch has been created. The herd has been created. I'm going to leave this bug open just as a reminder of a few other packages to include. Feel free to add ebuilds for them.
Comment 26 Daniel Black (RETIRED) gentoo-dev 2004-12-03 22:13:15 UTC
individual bugs created for outstanding ebuilds.
Comment 27 Michael Zanetta 2005-01-25 13:23:44 UTC
Hi,

One forensics tool that could be added is AIRT for "Advanced incident response tool"

It is new and actively devellopped

http://159.226.5.93/projects/airt.htm
Comment 28 Michael Zanetta 2005-01-25 13:34:57 UTC
I've found a long, long list of forensics tools on this site:

http://www.forinsect.de/forensics/forensics-tools.html

It is huge...
Comment 29 Daniel Black (RETIRED) gentoo-dev 2005-01-25 16:26:13 UTC
AIRT - bug  79524 
 The Sleuth Kit (TSK) - done
Autopsy - done
Pepijn Vissers released a patch - need to check
FLAG - obseleted by pyflag - bug 73301
mac-robber - not part of sleuthkit (just checked) will look at
Foremost - done
Magic Rescue - will look at
gpart - sys-apps/gpart - has a few bugs open on it.
The Coroner's Toolkit (TCT) - done
TCTutils - low pri - see if there is any value not included elsewhere

Network Forensics:
nstreams: need to look
slogdump - looks interesting.
tcpflow - net-analyzer/tcpflow - needs version bump
Chaosreader need to look
driftnet - need to look

Ftimes Project - last touched March 2004 - maybe - bug 73296 
bmap - looks interesting
autoclave - deleteing realy not in the interests of forensics :-)
cryptcat - cvs version as of 20031202 - doesn't seem to be maintained
Foundstone Forensic Utilities --  good link - hope these are better that the older versions on sourceforge.
Fenris - looks promising
e2recover - could be easy
NASA tool collection
- enhanced_loopback - 2.4 kernel only :-(
- fatback - sounds good - bug 73299
Carvdawg's Perl Page - maybe
md5deep - need to compare against ftimes
dcfldd - sys-apps/dcfldd
Cryogenic - nice
mcore - not sure its forensics
procshow - if this has something a lot better that other programs
Project Odessa: bug 73300 
Registry editors (non-Windows):
ntreg: - needed by pyflag - TODO
kregedit: wow - a gui - will look
chntpw: sneeky - not realy forensics though
e2salvage: - good compare to recover
kern_check: potentialy 
Faust: maybe
AIR: in portage app-forensics/air
memfetch: dumps the memory of a running process  - nice
memdump: - what special features?
elfcmp: a tool for comparing ELF binarys to processes  - neat
sdd: - don't think it adds that much.

 
chkrootkit: app-forensics/chkrootkit
Rootcheck: new rootkit detection tool. - will look at it
Rootkit Hunter: ap-forensics/rkhunter 

Mail analysis tools:

Mail Viewer.ok
ol2mbox: an Outlook to mbox format mail converter - looking into it
mboxgrep: ok
getattach.pl: probably covered elsewhere

Sources for Known-Good / Known-Bad hashsums:
look at adding support for these in pyflag

lots to look. any favourites?
Comment 30 Daniel Black (RETIRED) gentoo-dev 2005-01-25 16:34:25 UTC
more options - should write bugs on good ones initially.
Comment 31 Daniel Black (RETIRED) gentoo-dev 2005-01-25 18:19:13 UTC
kregedit-0.1 - compile failure


# Copyright 1999-2005 Gentoo Foundation
# Distributed under the terms of the GNU General Public License v2
# $Header: $

inherit kde

DESCRIPTION="kregedit is KDE utility for viewing native Windows registry files."
HOMEPAGE="http://jelmer.vernstok.nl/samba/kregedit/"
SRC_URI="http://jelmer.vernstok.nl/releases/${P}.tar.gz"
LICENSE="GPL-2"
SLOT="0"
KEYWORDS="~x86"

IUSE=""

editreg.cpp: In function `int data_to_ascii(unsigned char*, int, int, char*, int)':
editreg.cpp:1560: error: invalid conversion from `char*' to `unsigned char*'
editreg.cpp:1564: error: invalid conversion from `char*' to `unsigned char*'
editreg.cpp:1568: error: invalid conversion from `char*' to `unsigned char*'
editreg.cpp:1571: error: invalid conversion from `unsigned char*' to `char*'
editreg.cpp: In function `REGF_HDR* nt_get_regf_hdr(REGF*)':
editreg.cpp:1661: error: invalid conversion from `void*' to `char*'

tcpflow version bumped too
Comment 32 Daniel Black (RETIRED) gentoo-dev 2005-01-25 18:44:57 UTC
mac-robber-1.00 added. Added another URL.
Comment 33 Daniel Black (RETIRED) gentoo-dev 2005-01-25 19:00:41 UTC
app-forensics/magicrescue-1.1.4

it suggested JPEG recovery tools:
This seems to be the file type most people are trying to recover.  Available utilities include <http://www.cgsecurity.org/?photorec.html>, <http://codesink.org/recover.html>, and <http://www.vanheusden.com/findfile/>.
Comment 34 Daniel Black (RETIRED) gentoo-dev 2005-01-25 20:41:37 UTC
comment 33 http://www.cgsecurity.org/?photorec.html is part of app-admin/testdisk. version bumped to 5.5
Comment 35 Daniel Black (RETIRED) gentoo-dev 2005-04-28 02:09:01 UTC
http://dftt.sourceforge.net/ for test images.
Comment 36 Lars Wendler (Polynomial-C) (RETIRED) gentoo-dev 2009-03-08 00:27:39 UTC
This has been added to the portage tree for quite a while now. Marking as FIXED.