Re: Adding provenance
#ontology
#intro
#provenance
Go for it!
From: main@bonsai.groups.io <main@bonsai.groups.io>
On Behalf Of Massimo Pizzol via Groups.Io
Sent: 19 December 2019 13:11 To: main@bonsai.groups.io Subject: Re: [bonsai] Adding provenance #ontology #intro #provenance
Fine for me From:
main@bonsai.groups.io <main@bonsai.groups.io> on behalf of Matteo Lissandrini (AAU) via Groups.Io <matteo@...>
Hi all,
the pull request is still pending, Brandon had a nice comment that we are working on addressing.
Emil is anxious to get some more work done on this, I think we should not have his excitement fade ;)
If you all agree I would proceed merging the current pull request, and we will followup with more of them to enhance the current solution.
Please let us know.
Thanks, Matteo
--- From:
main@bonsai.groups.io <main@bonsai.groups.io> on behalf of Matteo Lissandrini (AAU) via Groups.Io <matteo@...>
Hi Chris, Michele, everyone.
We would really like to get your input on Emil's pull request. It is not a lot of code and it adds at least some minimum of metadata regarding the datasets and their provenance/lineage. Please let us know if we can merge it in.
Thanks, Matteo
--- From:
main@bonsai.groups.io <main@bonsai.groups.io> on behalf of Emil Riis Hansen via Groups.Io <emilrh@...>
Hi everyone,
|
|
Re: Adding provenance
#ontology
#intro
#provenance
Massimo Pizzol
Fine for me
From: main@bonsai.groups.io <main@bonsai.groups.io> on behalf of Matteo Lissandrini (AAU) via Groups.Io <matteo@...>
Sent: Tuesday, December 17, 2019 10:43:46 AM To: main@bonsai.groups.io Cc: Christopher Mutel; Michele De Rosa Subject: Re: [bonsai] Adding provenance #ontology #intro #provenance Hi all,
the pull request is still pending, Brandon had a nice comment that we are working on addressing.
Emil is anxious to get some more work done on this, I think we should not have his excitement fade ;)
If you all agree I would proceed merging the current pull request, and we will followup with more of them to enhance the current solution.
Please let us know.
Thanks, Matteo
---
Matteo Lissandrini Department of Computer Science Aalborg University http://people.cs.aau.dk/~matteo From: main@bonsai.groups.io <main@bonsai.groups.io> on behalf of Matteo Lissandrini (AAU) via Groups.Io <matteo@...>
Sent: 06 December 2019 09:06:56 To: main@bonsai.groups.io Subject: Re: [bonsai] Adding provenance #ontology #intro #provenance Hi Chris, Michele, everyone.
We would really like to get your input on Emil's pull request. It is not a lot of code and it adds at least some minimum of metadata regarding the datasets and their provenance/lineage. Please let us know if we can merge it in.
Thanks, Matteo
---
Matteo Lissandrini Department of Computer Science Aalborg University http://people.cs.aau.dk/~matteo From: main@bonsai.groups.io <main@bonsai.groups.io> on behalf of Emil Riis Hansen via Groups.Io <emilrh@...>
Sent: 03 December 2019 11:51:24 To: main@bonsai.groups.io Subject: Re: [bonsai] Adding provenance #ontology #intro #provenance Hi everyone,
I have prepared a pull request for the initial implementation of provenance. The request extends upon the work by the Arborist working group, by an initial minimal provenance implementation, which adds lineage information between instances of entities and the EXIOBASE dataset, as well as provenance information regarding the Arborist script itself. Further improvements will be needed and will arrive. The request also fixes the issue of "missing dataset declarations" from the RDF repository. Matteo has helped review the request before the submit, but I look forward to your feedback. Pull request: https://github.com/BONSAMURAIS/arborist/pull/14 Issue: https://github.com/BONSAMURAIS/rdf/issues/3 Best Regards, Emil
|
|
Re: Adding provenance
#ontology
#intro
#provenance
Matteo Lissandrini (AAU)
Hi all,
the pull request is still pending, Brandon had a nice comment that we are working on addressing.
Emil is anxious to get some more work done on this, I think we should not have his excitement fade ;)
If you all agree I would proceed merging the current pull request, and we will followup with more of them to enhance the current solution.
Please let us know.
Thanks, Matteo
---
Matteo Lissandrini Department of Computer Science Aalborg University http://people.cs.aau.dk/~matteo
From: main@bonsai.groups.io <main@bonsai.groups.io> on behalf of Matteo Lissandrini (AAU) via Groups.Io <matteo@...>
Sent: 06 December 2019 09:06:56 To: main@bonsai.groups.io Subject: Re: [bonsai] Adding provenance #ontology #intro #provenance Hi Chris, Michele, everyone.
We would really like to get your input on Emil's pull request. It is not a lot of code and it adds at least some minimum of metadata regarding the datasets and their provenance/lineage. Please let us know if we can merge it in.
Thanks, Matteo
---
Matteo Lissandrini Department of Computer Science Aalborg University http://people.cs.aau.dk/~matteo From: main@bonsai.groups.io <main@bonsai.groups.io> on behalf of Emil Riis Hansen via Groups.Io <emilrh@...>
Sent: 03 December 2019 11:51:24 To: main@bonsai.groups.io Subject: Re: [bonsai] Adding provenance #ontology #intro #provenance Hi everyone,
I have prepared a pull request for the initial implementation of provenance. The request extends upon the work by the Arborist working group, by an initial minimal provenance implementation, which adds lineage information between instances of entities and the EXIOBASE dataset, as well as provenance information regarding the Arborist script itself. Further improvements will be needed and will arrive. The request also fixes the issue of "missing dataset declarations" from the RDF repository. Matteo has helped review the request before the submit, but I look forward to your feedback. Pull request: https://github.com/BONSAMURAIS/arborist/pull/14 Issue: https://github.com/BONSAMURAIS/rdf/issues/3 Best Regards, Emil
|
|
Mark your calendars: two presentations from similar projects
Dear all-
After a successful introduction to the work being done by the US EPA, we will have two more presentations from projects where there could be exchanges of data and ideas. On January 10, 2020, from 15:00-16:00 CET, Joseph Poore will present Hestia, a new initiative to make agriculture and food LCA data more open and comprehensive, initially building on this article: https://science.sciencemag.org/content/360/6392/987.full?ijkey=ffyeW1F0oSl6k&keytype=ref&siteid=sci. On Feb. 21, 2020, from 15:00-16:00 CET, the TRASE (https://trase.earth) team will present their project. They are also interested in hearing about BONSAI, so we will need to prepare some materials ahead of this call. Both presentations will be from people who have thought deeply about managing and sharing large open datasets, and we should show them respect by attending en masse and on time :) Bo, could you or someone else with the necessary permissions send our Zoom links for both events? Yours, Chris -- ############################ Chris Mutel Technology Assessment Group, LEA Paul Scherrer Institut OHSA D22 5232 Villigen PSI Switzerland http://chris.mutel.org Telefon: +41 56 310 5787 ############################
|
|
Re: Communication platforms- Ground rules
#communication
#knowledgemanagement
Bo Weidema
Thumbs up! My full support. When we have multiple channels of cooperation/communication, it is so important that we use them for clearly distinct purposes and cross-link whenever relevant. Agneta's proposal point us in this direction. Best regards Bo Den 2019/12/09 kl. 16.38 skrev Agneta:
|
|
CSL or other standards for data source provenance?
Ingwersen, Wesley
Hi BONSAI, I know that you have actively been working on data source metadata descriptions. I’ve been wanting to improve this for some of the tools in our ecosystem as well. Has anyone looked into using the CSL (citation style language) schema to try to apply it to datasets? https://github.com/citation-style-language/schema
A nice aspect of this is that there are convertor tools to put this kind of source metadata into Bibtex like https://github.com/larsgw/citation.js/ for use with citation manager or rendering the same datasource citations in reports/papers.
I know this is not RDF based but since its JSON encoded it would seem there would be easy conversion.
I’d just like to know if any of use had considered CSL-JSON?
Regards,
Wesley W. Ingwersen, Ph.D. Center for Environmental Solutions and Emergency Response (CESER) US EPA Office of Research and Development 61 Forsyth Street, SW Atlanta, GA 30303
|
|
Communication platforms- Ground rules
#communication
#knowledgemanagement
Dear all There have been several concerns about multiple communication channels in BONSAI which make it challenging to follow on what's going on and how to contribute.To resolve this issue, I suggest some ground rules: BONSAI github -
Slack-
Bonsai Wiki
I hope this will help BONSAI members to navigate through the ongoing work on the BONSAI platform Best wishes Agneta
|
|
Re: Adding provenance
#ontology
#intro
#provenance
Matteo Lissandrini (AAU)
Hi Chris, Michele, everyone.
We would really like to get your input on Emil's pull request. It is not a lot of code and it adds at least some minimum of metadata regarding the datasets and their provenance/lineage. Please let us know if we can merge it in.
Thanks, Matteo
---
Matteo Lissandrini Department of Computer Science Aalborg University http://people.cs.aau.dk/~matteo
From: main@bonsai.groups.io <main@bonsai.groups.io> on behalf of Emil Riis Hansen via Groups.Io <emilrh@...>
Sent: 03 December 2019 11:51:24 To: main@bonsai.groups.io Subject: Re: [bonsai] Adding provenance #ontology #intro #provenance Hi everyone,
I have prepared a pull request for the initial implementation of provenance. The request extends upon the work by the Arborist working group, by an initial minimal provenance implementation, which adds lineage information between instances of entities and the EXIOBASE dataset, as well as provenance information regarding the Arborist script itself. Further improvements will be needed and will arrive. The request also fixes the issue of "missing dataset declarations" from the RDF repository. Matteo has helped review the request before the submit, but I look forward to your feedback. Pull request: https://github.com/BONSAMURAIS/arborist/pull/14 Issue: https://github.com/BONSAMURAIS/rdf/issues/3 Best Regards, Emil
|
|
Discussion/collaboration with TRASE project
Dear all-
I have reached out to the TRASE project (https://trase.earth/), and they would be interested in presenting their project to us and getting some idea of how we could work together. They have quite a lot (both data and workflows) that we could build on, and I think we can offer a lot ourselves. A good date for them would be Feb. 21, from 15:00 - 16:30 CET (probably wouldn't take that long, but better to reserve the time just in case). Please fill in the following Doodle if you could attend **by Wednesday, Dec. 11**. Thanks! https://doodle.com/poll/bbh9ui2cnp6d3b4m -Chris -- ############################ Chris Mutel Technology Assessment Group, LEA Paul Scherrer Institut OHSA D22 5232 Villigen PSI Switzerland http://chris.mutel.org Telefon: +41 56 310 5787 ############################
|
|
Re: Adding provenance
#ontology
#intro
#provenance
Emil Riis Hansen
Hi everyone,
I have prepared a pull request for the initial implementation of provenance. The request extends upon the work by the Arborist working group, by an initial minimal provenance implementation, which adds lineage information between instances of entities and the EXIOBASE dataset, as well as provenance information regarding the Arborist script itself. Further improvements will be needed and will arrive. The request also fixes the issue of "missing dataset declarations" from the RDF repository. Matteo has helped review the request before the submit, but I look forward to your feedback. Pull request: https://github.com/BONSAMURAIS/arborist/pull/14 Issue: https://github.com/BONSAMURAIS/rdf/issues/3 Best Regards, Emil
|
|
Re: Base nomenclature - theory into practice
Miguel Fernández Astudillo
Hi
toggle quoted messageShow quoted text
Having a look to the state of the wiki of the openenergyplatform, it does not seem that the ontology has advanced much. https://github.com/OpenEnergyPlatform/ontology/wiki but it would be worth double-checking with Ludwig Hulk and or Martin Glauer, I think both involved in the development of an ontology to represent energy scenarios. I'd contact also Daniel Huppmann (IIASA), to see how are they planning to get around this issue in the openentrance (https://openentrance.eu/) project. If there is nothing that we can use, for energy products I think it makes sense to use the UN names as much as possible (https://unstats.un.org/unsd/energy/ESCM_Whitecover_170323.pdf) For activities, NACE is very vague, and as you point out it does not make any difference between electricity producers. NAICS provides some more detail https://classcodes.com/lookup/naics-5-digit-industry-22111/ It is quite incredible that with the importance of the electricity sector there are no more standard names to call technologies... Best, Miguel
-----Original Message-----
From: main@bonsai.groups.io <main@bonsai.groups.io> On Behalf Of Chris Mutel Sent: 28 November 2019 10:26 To: main@bonsai.groups.io Subject: [bonsai] Base nomenclature - theory into practice Dear all- PSI and LIST are part of a consortium of research groups trying to make prospective LCA better. To accomplish this, we have decided to create a standard implementation merging LCI databases with scenarios from energy system models or integrated assessment models. The software would be in Python and based on https://github.com/IndEcol/wurst. As our aim is to support multiple systems, we need a reference base nomenclature for products and activities. As far as I can tell, we have invested a lot in building up various correspondence tables, but do not have a lot of development on a base nomenclature with scientific justification. (On the other hand, I think we have made a lot of progress in how to describe any such system.) I assume that such a system will start with a standard classification (e.g. GS1, NACE, etc.), and then use industry-specific classifications when more detail is needed (e.g. https://en.wikipedia.org/wiki/SAE_steel_grades). One important exception here is electricity, where I don't find a standard system that captures the level of detail we need (e.g. utility versus roof-top solar). As Tomas N. and I are responsible for the technical foundation of this consortium, we have the chance to build it BONSAI-compatible from the beginning - but we need to make decisions soon on this critical issue. Any input from the list would be greatly appreciated. -Chris
|
|
Re: Base nomenclature - theory into practice
Bo Weidema
Hi Chris, Would be happy to help, but what is your question? In BONSAI
parlance, I think the "base classification" is the one that at any
point in time is most detailed. Bo Den 28.11.2019 kl. 10.25 skrev Chris
Mutel:
Dear all- PSI and LIST are part of a consortium of research groups trying to make prospective LCA better. To accomplish this, we have decided to create a standard implementation merging LCI databases with scenarios from energy system models or integrated assessment models. The software would be in Python and based on https://github.com/IndEcol/wurst. As our aim is to support multiple systems, we need a reference base nomenclature for products and activities. As far as I can tell, we have invested a lot in building up various correspondence tables, but do not have a lot of development on a base nomenclature with scientific justification. (On the other hand, I think we have made a lot of progress in how to describe any such system.) I assume that such a system will start with a standard classification (e.g. GS1, NACE, etc.), and then use industry-specific classifications when more detail is needed (e.g. https://en.wikipedia.org/wiki/SAE_steel_grades). One important exception here is electricity, where I don't find a standard system that captures the level of detail we need (e.g. utility versus roof-top solar). As Tomas N. and I are responsible for the technical foundation of this consortium, we have the chance to build it BONSAI-compatible from the beginning - but we need to make decisions soon on this critical issue. Any input from the list would be greatly appreciated. -Chris --
|
|
Base nomenclature - theory into practice
Dear all-
PSI and LIST are part of a consortium of research groups trying to make prospective LCA better. To accomplish this, we have decided to create a standard implementation merging LCI databases with scenarios from energy system models or integrated assessment models. The software would be in Python and based on https://github.com/IndEcol/wurst. As our aim is to support multiple systems, we need a reference base nomenclature for products and activities. As far as I can tell, we have invested a lot in building up various correspondence tables, but do not have a lot of development on a base nomenclature with scientific justification. (On the other hand, I think we have made a lot of progress in how to describe any such system.) I assume that such a system will start with a standard classification (e.g. GS1, NACE, etc.), and then use industry-specific classifications when more detail is needed (e.g. https://en.wikipedia.org/wiki/SAE_steel_grades). One important exception here is electricity, where I don't find a standard system that captures the level of detail we need (e.g. utility versus roof-top solar). As Tomas N. and I are responsible for the technical foundation of this consortium, we have the chance to build it BONSAI-compatible from the beginning - but we need to make decisions soon on this critical issue. Any input from the list would be greatly appreciated. -Chris
|
|
Re: Presentation by Wes Ingwersen, US EPA - Friday, Nov. 22 - 15:00 CET/9:00 EST
Ingwersen, Wesley
Hello All,
toggle quoted messageShow quoted text
Thank you for attending the presentation today for those who could make it. My slides are attached for all with some annotations. Links are embedded to most of the tools. I look forward to more conversations about our collaboration. Wes Wesley W. Ingwersen, Ph.D. Environmental Decision Analytics Branch/Land Remediation and Technology Division Center for Environmental Solutions and Emergency Response (CESER) US EPA Office of Research and Development 61 Forsyth Street, SW Atlanta, GA 30303
-----Original Message-----
From: main@bonsai.groups.io <main@bonsai.groups.io> On Behalf Of Chris Mutel Sent: Friday, November 22, 2019 8:00 AM To: main@bonsai.groups.io Subject: Re: [bonsai] Presentation by Wes Ingwersen, US EPA - Friday, Nov. 22 - 15:00 CET/9:00 EST Reminder that Wes will be presenting today in one hour. Here are the connection data: Time: Nov 22, 2019 03:00 PM Copenhagen Join Zoom Meeting https://zoom.us/j/799298250 Meeting ID: 799 298 250 Find your local number: https://zoom.us/u/acOELCujEO On Mon, 11 Nov 2019 at 23:26, Christopher Mutel <cmutel@gmail.com> wrote:
-- ############################ Chris Mutel Technology Assessment Group, LEA Paul Scherrer Institut OHSA D22 5232 Villigen PSI Switzerland http://chris.mutel.org Telefon: +41 56 310 5787 ############################
|
|
Re: Presentation by Wes Ingwersen, US EPA - Friday, Nov. 22 - 15:00 CET/9:00 EST
Matteo Lissandrini (AAU)
Hi Chris,
unfortunately I will not be able to join due to other meetings, but if there is any material (e.g., slides or notes) I will be happy to take a look.
Thanks, Matteo
---
Matteo Lissandrini Department of Computer Science Aalborg University http://people.cs.aau.dk/~matteo
From: main@bonsai.groups.io <main@bonsai.groups.io> on behalf of Chris Mutel via Groups.Io <cmutel@...>
Sent: 22 November 2019 14:00:00 To: main@bonsai.groups.io Subject: Re: [bonsai] Presentation by Wes Ingwersen, US EPA - Friday, Nov. 22 - 15:00 CET/9:00 EST Reminder that Wes will be presenting today in one hour.
Here are the connection data: Time: Nov 22, 2019 03:00 PM Copenhagen Join Zoom Meeting https://zoom.us/j/799298250 Meeting ID: 799 298 250 Find your local number: https://zoom.us/u/acOELCujEO On Mon, 11 Nov 2019 at 23:26, Christopher Mutel <cmutel@...> wrote: > > Dear all- > > I would like to invite Wes Ingwersen to present the work that the US > EPA is doing on open data infrastructure and associated efforts to the > BONSAI group. We have had a "hang out" on Friday afternoons before, > and that time works well for him, so those who are interested and > available are welcome to join. > > Bo, can you send out a Zoom link? > > -Chris > > -- > ############################ > Chris Mutel > Technology Assessment Group, LEA > Paul Scherrer Institut > OHSA D22 > 5232 Villigen PSI > Switzerland > http://chris.mutel.org > Telefon: +41 56 310 5787 > ############################ -- ############################ Chris Mutel Technology Assessment Group, LEA Paul Scherrer Institut OHSA D22 5232 Villigen PSI Switzerland http://chris.mutel.org Telefon: +41 56 310 5787 ############################
|
|
Re: Presentation by Wes Ingwersen, US EPA - Friday, Nov. 22 - 15:00 CET/9:00 EST
Reminder that Wes will be presenting today in one hour.
toggle quoted messageShow quoted text
Here are the connection data: Time: Nov 22, 2019 03:00 PM Copenhagen Join Zoom Meeting https://zoom.us/j/799298250 Meeting ID: 799 298 250 Find your local number: https://zoom.us/u/acOELCujEO
On Mon, 11 Nov 2019 at 23:26, Christopher Mutel <cmutel@gmail.com> wrote:
--
############################ Chris Mutel Technology Assessment Group, LEA Paul Scherrer Institut OHSA D22 5232 Villigen PSI Switzerland http://chris.mutel.org Telefon: +41 56 310 5787 ############################
|
|
Re: Adding provenance
#ontology
#intro
#provenance
Emil Riis Hansen
Hi Michele
Username: IKnowLogic I will share some more details soon before creating the PR Thank you, Michele
Best Regards Emil Riis Hansen
From: main@bonsai.groups.io <main@bonsai.groups.io> on behalf of Michele De Rosa via Groups.Io <michele.derosa@...>
Sent: Friday, November 15, 2019 9:46:47 AM To: main@bonsai.groups.io Subject: Re: [bonsai] Adding provenance #ontology #intro #provenance Hi Emil,
send me your GitHub username. Mic
|
|
Re: Adding provenance
#ontology
#intro
#provenance
Hi Emil,
send me your GitHub username. Mic
|
|
Re: Adding provenance
#ontology
#intro
#provenance
Emil Riis Hansen
Hello everyone,
I have made a proposed first implementation of provenance in the BONSAI project, including lineage information for flows, activityTypes, and locations as well as versioning of the activity (Arborist Script), used in the extraction of the data. I believe the implementation satisfies our initial requirements, or at least the requirements needed to write a resource paper regarding the BONSAI database. The proposal is very flexible, and can easily be extended or changed. I would like to share the proposal by a pull quest. How do I get permission to do this? Best regards Emil
|
|
Re: Adding provenance
#ontology
#intro
#provenance
Matteo Lissandrini (AAU)
Hi all,
so what is listed as case 1) by Bo is what Emil proposal is about.
The idea is to annotate provenance of the named graphs we have. This is a first, necessary, step because without that the data in each named graph is "orphan" of any basic information required by provenance.
Emil will come up with a proposal on what we need to extend in our scripts in order to have this information, I think it will be a few additions to the arborist code.
Thanks, Matteo
---
Matteo Lissandrini Department of Computer Science Aalborg University http://people.cs.aau.dk/~matteo
From: main@bonsai.groups.io <main@bonsai.groups.io> on behalf of loekke via Groups.Io <loekke@...>
Sent: 14 November 2019 13:17:14 To: main@bonsai.groups.io Subject: Re: [bonsai] Adding provenance #ontology #intro #provenance Yes, this is also in line with the talk we had with Emil yesterday
|
|